Jul 03 13:46:34 devstack cinder-volume[75518]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 13:46:34 devstack cinder-volume[75518]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 13:46:34 devstack cinder-volume[75518]: we strongly recommend against using it for new projects. Jul 03 13:46:34 devstack cinder-volume[75518]: If you are already using Eventlet, we recommend migrating to a different Jul 03 13:46:34 devstack cinder-volume[75518]: framework. For more detail see Jul 03 13:46:34 devstack cinder-volume[75518]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 13:46:34 devstack cinder-volume[75518]: import eventlet # noqa Jul 03 13:46:36 devstack cinder-volume[75518]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 13:46:36 devstack cinder-volume[75518]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 13:46:36 devstack cinder-volume[75518]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 13:46:37 devstack cinder-volume[75518]: INFO dbcounter [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Registered counter for database cinder Jul 03 13:46:37 devstack cinder-volume[75518]: DEBUG oslo_db.sqlalchemy.engines [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:46:38 devstack cinder-volume[75518]: DEBUG dbcounter [-] [75518] Writer thread running {{(pid=75518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 13:46:38 devstack cinder-volume[75518]: INFO cinder.rpc [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 13:46:38 devstack cinder-volume[75518]: INFO cinder.rpc [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 13:46:38 devstack cinder-volume[75518]: DEBUG oslo_db.sqlalchemy.engines [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:46:38 devstack cinder-volume[75518]: INFO cinder.volume.manager [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Determined volume DB was empty at startup. Jul 03 13:46:38 devstack cinder-volume[75518]: DEBUG cinder.volume.manager [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75518) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jul 03 13:46:38 devstack cinder-volume[75518]: INFO cinder.volume.manager [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 03 13:46:38 devstack cinder-volume[75518]: WARNING stevedore.named [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 13:46:38 devstack cinder-volume[75518]: WARNING castellan.key_manager [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 13:46:38 devstack cinder-volume[75518]: WARNING cinder.keymgr.conf_key_mgr [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 13:46:38 devstack cinder-volume[75518]: DEBUG cinder.volume.drivers.lvm [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75518) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 03 13:46:38 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:38 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] CMD "cinder-rtstool verify" returned: 0 in 0.477s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:38 devstack cinder-volume[75518]: DEBUG oslo_db.sqlalchemy.engines [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:46:38 devstack cinder-volume[75518]: INFO cinder.rpc [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 03 13:46:38 devstack cinder-volume[75518]: INFO cinder.rpc [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 03 13:46:38 devstack cinder-volume[75518]: WARNING stevedore.named [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 13:46:38 devstack cinder-volume[75518]: WARNING castellan.key_manager [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 13:46:38 devstack cinder-volume[75518]: INFO cinder.volume.manager [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 03 13:46:38 devstack cinder-volume[75518]: DEBUG oslo_db.sqlalchemy.engines [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:46:39 devstack cinder-volume[75518]: INFO oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Starting 1 workers Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Started child 75716 {{(pid=75518) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Full set of CONF: {{(pid=75518) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] ******************************************************************************** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Configuration options gathered from: {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] ================================================================================ {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] allow_availability_zone_fallback = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] allow_compression_on_image_upload = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] allowed_direct_url_schemes = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] api_rate_limit = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75716]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] auth_strategy = keystone {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] az_cache_duration = 3600 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_availability_zone = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_host = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_stats_polling_interval = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backup_api_class = cinder.backup.api.API {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backup_name_template = backup-%s {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backup_use_same_host = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backup_use_temp_snapshot = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] chap_password = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] chap_username = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cinder_internal_tenant_project_id = 533e724de8294fe9824b72cfb16b9be7 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cinder_internal_tenant_user_id = cd86ff79191f479fa6b8391314719922 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cloned_volume_same_az = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cluster = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] compression_format = gzip {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] compute_api_class = cinder.compute.nova.API {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] config_dir = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] config_source = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] control_exchange = openstack {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] debug = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] default_availability_zone = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] default_group_type = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] default_volume_type = lvmdriver-1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] disk_geometry = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] driver_client_cert = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] driver_client_cert_key = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] driver_data_namespace = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] driver_ssl_cert_path = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] driver_ssl_cert_verify = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] driver_use_ssl = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] enable_force_upload = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] enable_new_services = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] enable_unsupported_driver = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] enabled_backends = ['lvmdriver-1'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] enforce_multipath_for_image_xfer = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] filter_function = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance_api_insecure = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance_api_servers = ['http://192.168.122.214/image'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance_api_ssl_compression = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance_ca_certificates_file = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance_catalog_info = image:glance:publicURL {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance_certfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance_keyfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance_num_retries = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance_request_timeout = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] goodness_function = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] graceful_shutdown_timeout = 5 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] group_api_class = cinder.group.api.API {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] host = devstack {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] image_compress_on_upload = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] image_conversion_address_space_limit = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] image_conversion_cpu_limit = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] image_conversion_disable = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] image_upload_use_cinder_backend = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] image_upload_use_internal_tenant = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] image_volume_cache_enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] image_volume_cache_max_count = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] image_volume_cache_max_size_gb = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] init_host_max_objects_retrieval = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] instance_format = [instance: %(uuid)s] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] iscsi_target_flags = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] iscsi_write_cache = on {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] iser_helper = tgtadm {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] iser_ip_address = 192.168.122.214 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] iser_port = 3260 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] log_color = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] log_config_append = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] log_dir = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] log_file = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] log_options = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] log_rotate_interval = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] log_rotate_interval_type = days {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] log_rotation_type = none {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] max_age = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] max_logfile_count = 30 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] max_logfile_size_mb = 200 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] max_over_subscription_ratio = 20.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] message_reap_interval = 86400 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] message_ttl = 2592000 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] migration_create_volume_timeout_secs = 300 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] monkey_patch = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] monkey_patch_modules = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] my_ip = 192.168.122.214 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] no_snapshot_gb_quota = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] num_iser_scan_tries = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] num_shell_tries = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] num_volume_device_scan_tries = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] nvmeof_conn_info_version = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] nvmet_ns_id = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] nvmet_port_id = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] osapi_max_limit = 1000 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] osapi_volume_ext_list = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] osapi_volume_listen = 0.0.0.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] osapi_volume_listen_port = 8776 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] osapi_volume_use_ssl = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] osapi_volume_workers = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] per_volume_size_limit = -1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] periodic_fuzzy_delay = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] periodic_interval = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] project_id_regex = [0-9a-f\-]+ {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] public_endpoint = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] publish_errors = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] quota_backup_gigabytes = 1000 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] quota_backups = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] quota_gigabytes = 1000 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] quota_groups = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75716]: INFO cinder.volume.manager [None req-216f209c-6d17-4233-afda-231ce449586a None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] quota_snapshots = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] quota_volumes = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] rate_limit_burst = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] rate_limit_except_level = CRITICAL {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] rate_limit_interval = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] reinit_driver_count = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] replication_device = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] report_discard_supported = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] report_interval = 120 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] reservation_clean_interval = 86400 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] reservation_expire = 86400 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] reserved_image_namespaces = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] reserved_percentage = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] rpc_response_timeout = 120 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] run_external_periodic_tasks = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] scst_target_driver = iscsi {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] scst_target_iqn_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] service_down_time = 720 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] shell_completion = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] snapshot_name_template = snapshot-%s {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] snapshot_same_host = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] split_loggers = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] state_path = /opt/stack/data/cinder {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] storage_availability_zone = nova {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] storage_protocol = iSCSI {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] syslog_log_facility = LOG_USER {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] target_helper = lioadm {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] target_ip_address = 192.168.122.214 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] target_port = 3260 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] target_protocol = iscsi {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] target_secondary_ip_addresses = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] trace_flags = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] transfer_api_class = cinder.transfer.api.API {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] transport_url = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] until_refresh = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] use_chap_auth = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] use_default_quota_class = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] use_journal = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] use_json = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] use_multipath_for_image_xfer = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] use_stderr = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] use_syslog = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] verify_glance_signatures = enabled {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] volume_api_class = cinder.volume.api.API {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] volume_backend_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] volume_clear = zero {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] volume_clear_ionice = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] volume_clear_size = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] volume_copy_bps_limit = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] volume_dd_blocksize = 1M {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] volume_name_template = volume-%s {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] volume_service_inithost_offload = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] volume_usage_audit_period = month {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] zoning_mode = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_concurrency.disable_process_locking = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.auth_section = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.auth_type = password {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.auth_version = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.cache = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.certfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.delay_auth_decision = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.http_connect_timeout = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.include_service_catalog = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.insecure = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.interface = public {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.keyfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.memcache_password = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.memcache_username = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.region_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.service_token_roles_required = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.service_type = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.token_cache_time = 300 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.214/identity {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.backend = dogpile.cache.null {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.backend_argument = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.backend_expiration_time = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.config_prefix = cache.oslo {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.debug_cache_backend = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.enable_retry_client = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.enable_socket_keepalive = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.expiration_time = 600 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.hashclient_retry_attempts = 2 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.memcache_dead_retry = 300 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.memcache_pool_maxsize = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.memcache_sasl_enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.password = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.proxies = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.redis_db = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.redis_sentinel_service_name = mymaster {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.redis_server = localhost:6379 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.retry_attempts = 2 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.retry_delay = 0.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.socket_keepalive_count = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.socket_keepalive_idle = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.socket_keepalive_interval = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.socket_timeout = 1.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.tls_allowed_ciphers = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.tls_cafile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.tls_certfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.tls_enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.tls_keyfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cache.username = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] coordination.backend_url = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.asyncio_connection = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.asyncio_slave_connection = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.backend = sqlalchemy {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.connection = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.connection_debug = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.connection_parameters = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.connection_recycle_time = 3600 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.connection_trace = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.db_inc_retry_interval = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.db_max_retries = 20 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.db_max_retry_interval = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.db_retry_interval = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.max_overflow = 50 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.max_pool_size = 5 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.max_retries = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.mysql_wsrep_sync_wait = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.pool_timeout = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.retry_interval = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.slave_connection = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.sqlite_synchronous = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.synchronous_reader = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] database.use_db_reconnect = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] profiler.connection_string = messaging:// {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] profiler.enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] profiler.es_doc_type = notification {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] profiler.es_scroll_size = 10000 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] profiler.es_scroll_time = 2m {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] profiler.filter_error_trace = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] profiler.hmac_keys = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] profiler.sentinel_service_name = mymaster {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] profiler.socket_timeout = 0.1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] profiler.trace_requests = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] profiler.trace_sqlalchemy = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] profiler_jaeger.process_tags = {} {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] profiler_jaeger.service_name_prefix = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] profiler_otlp.service_name_prefix = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_policy.enforce_new_defaults = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_policy.enforce_scope = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_policy.policy_default_rule = default {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack sudo[75720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_policy.policy_file = policy.yaml {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack sudo[75720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_policy.remote_timeout = 60.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] privsep_osbrick.group = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] privsep_osbrick.helper_command = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] privsep_osbrick.user = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cinder_sys_admin.group = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cinder_sys_admin.helper_command = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] cinder_sys_admin.user = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] service_user.auth_section = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] service_user.auth_type = password {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] service_user.cafile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] service_user.certfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] service_user.collect_timing = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] service_user.insecure = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] service_user.keyfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] service_user.send_service_user_token = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] service_user.split_loggers = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] service_user.timeout = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance.auth_section = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance.auth_type = password {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance.certfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance.collect_timing = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance.insecure = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance.keyfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance.region_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance.split_loggers = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] glance.timeout = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.backend_availability_zone = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.chap_password = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.chap_username = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.disk_geometry = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.driver_client_cert = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.driver_client_cert_key = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.driver_data_namespace = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.driver_use_ssl = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.enable_unsupported_driver = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.extra_capabilities = {} {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.filter_function = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.goodness_function = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.iscsi_target_flags = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.iscsi_write_cache = on {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.iser_helper = tgtadm {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.iser_ip_address = 192.168.122.214 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.iser_port = 3260 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.lvm_mirrors = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.lvm_share_target = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.lvm_type = auto {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.num_shell_tries = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.nvmet_port_id = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.replication_device = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.report_discard_supported = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.reserved_percentage = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.scst_target_driver = iscsi {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.scst_target_iqn_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.storage_protocol = iSCSI {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.target_helper = tgtadm {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.target_ip_address = 192.168.122.214 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.target_port = 3260 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.target_protocol = iscsi {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.trace_flags = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.unique_fqdn_network = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.use_chap_auth = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.volume_backend_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.volume_clear = zero {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.volume_clear_ionice = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.volume_clear_size = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.volume_group = cinder-volumes {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_reports.file_event_handler = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_reports.log_dir = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.backend_availability_zone = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.backend_host = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.chap_password = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.chap_username = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.chiscsi_conf = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.disk_geometry = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.driver_client_cert = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.driver_data_namespace = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.driver_use_ssl = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.extra_capabilities = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.filter_function = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.goodness_function = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.iser_helper = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.iser_ip_address = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.iser_port = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.iser_target_prefix = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.lvm_conf_file = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.lvm_mirrors = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.lvm_share_target = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.lvm_type = auto {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.num_shell_tries = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.nvmet_port_id = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.replication_device = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.report_discard_supported = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.reserved_percentage = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.scst_target_driver = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.storage_protocol = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.target_helper = lioadm {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.target_ip_address = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.target_port = 3260 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.target_protocol = iscsi {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.trace_flags = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.use_chap_auth = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.volume_clear = zero {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.volume_clear_size = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] lvmdriver-1.volumes_dir = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.ssl = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.ssl_version = {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_notifications.driver = [] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_notifications.retry = -1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] oslo_messaging_notifications.transport_url = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] key_manager.fixed_key = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican.barbican_api_version = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican.barbican_endpoint = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican.barbican_endpoint_type = public {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican.barbican_region_name = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican.cafile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican.certfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican.collect_timing = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican.insecure = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican.keyfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican.number_of_retries = 60 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican.retry_delay = 1 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican.send_service_user_token = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican.split_loggers = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican.timeout = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican.verify_ssl = True {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican.verify_ssl_path = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican_service_user.auth_section = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican_service_user.auth_type = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican_service_user.cafile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican_service_user.certfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican_service_user.collect_timing = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican_service_user.insecure = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican_service_user.keyfile = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican_service_user.split_loggers = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] barbican_service_user.timeout = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] vault.approle_role_id = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] vault.approle_secret_id = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] vault.kv_mountpoint = secret {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] vault.kv_path = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] vault.kv_version = 2 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] vault.namespace = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] vault.root_token_id = **** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] vault.ssl_ca_crt_file = None {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] vault.timeout = 60.0 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] vault.use_ssl = False {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:46:39 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] ******************************************************************************** {{(pid=75518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 13:46:39 devstack sudo[75720]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:39 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.715s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:39 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:39 devstack sudo[75834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:46:39 devstack sudo[75834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:40 devstack sudo[75834]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:40 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.669s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:40 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:46:40 devstack cinder-volume[75716]: INFO cinder.brick.local_dev.lvm [None req-216f209c-6d17-4233-afda-231ce449586a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 03 13:46:40 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:40 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:40 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:40 devstack sudo[76058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:46:40 devstack sudo[76058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:41 devstack sudo[76058]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:41 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:41 devstack cinder-volume[75716]: DEBUG cinder.brick.local_dev.lvm [None req-216f209c-6d17-4233-afda-231ce449586a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75716) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 03 13:46:41 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:41 devstack sudo[76285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:46:41 devstack sudo[76285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:42 devstack sudo[76285]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:42 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.327s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:42 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:42 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:42 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:42 devstack sudo[76473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:46:42 devstack sudo[76473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:43 devstack sudo[76473]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:43 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.728s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:43 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:43 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:43 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:43 devstack sudo[76498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 03 13:46:43 devstack sudo[76498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:44 devstack sudo[76498]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:44 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.750s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:44 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:44 devstack sudo[76502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:46:44 devstack sudo[76502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:45 devstack sudo[76502]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:45 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.896s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:45 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:45 devstack sudo[76513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:46:45 devstack sudo[76513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:45 devstack sudo[76513]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:45 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.933s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:45 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:45 devstack sudo[76518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:46:45 devstack sudo[76518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:46 devstack sudo[76518]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:46 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.730s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:46 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:46 devstack sudo[76527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:46:46 devstack sudo[76527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:47 devstack sudo[76527]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:47 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.729s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:47 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:47 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:47 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:47 devstack sudo[76531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:46:47 devstack sudo[76531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:48 devstack sudo[76531]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:48 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.752s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:48 devstack cinder-volume[75716]: INFO cinder.volume.drivers.lvm [None req-216f209c-6d17-4233-afda-231ce449586a None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 03 13:46:48 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:48 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:48 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:48 devstack sudo[76544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:46:48 devstack sudo[76544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:48 devstack sudo[76544]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:48 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.706s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:48 devstack cinder-volume[75716]: DEBUG cinder.volume.drivers.lvm [None req-216f209c-6d17-4233-afda-231ce449586a None None] Updating volume stats {{(pid=75716) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 13:46:48 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:48 devstack sudo[76658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:46:48 devstack sudo[76658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:49 devstack cinder-volume[75518]: DEBUG dbcounter [-] [75518] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:46:49 devstack sudo[76658]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:49 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:49 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:49 devstack sudo[76799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:46:49 devstack sudo[76799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:50 devstack sudo[76799]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:50 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:50 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:50 devstack sudo[76802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:46:50 devstack sudo[76802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:50 devstack sudo[76802]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:50 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:50 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:50 devstack sudo[76806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:46:50 devstack sudo[76806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:51 devstack sudo[76806]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:51 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:51 devstack cinder-volume[75716]: INFO cinder.volume.driver [None req-216f209c-6d17-4233-afda-231ce449586a None None] Driver hasn't implemented _init_vendor_properties() Jul 03 13:46:51 devstack cinder-volume[75716]: DEBUG cinder.volume.driver [None req-216f209c-6d17-4233-afda-231ce449586a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75716) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jul 03 13:46:51 devstack cinder-volume[75716]: DEBUG oslo_db.sqlalchemy.engines [None req-216f209c-6d17-4233-afda-231ce449586a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75716) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:46:51 devstack cinder-volume[75716]: DEBUG dbcounter [-] [75716] Writer thread running {{(pid=75716) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 13:46:51 devstack cinder-volume[75716]: DEBUG cinder.db.sqlalchemy.api [None req-216f209c-6d17-4233-afda-231ce449586a None None] Building query based on filter {{(pid=75716) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jul 03 13:46:51 devstack cinder-volume[75716]: DEBUG cinder.image.image_utils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75716) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jul 03 13:46:51 devstack cinder-volume[75716]: INFO cinder.keymgr.migration [None req-193296bf-543a-4e41-8117-5094f09374f2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 13:46:51 devstack cinder-volume[75716]: DEBUG cinder.volume.drivers.lvm [None req-216f209c-6d17-4233-afda-231ce449586a None None] Updating volume stats {{(pid=75716) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 13:46:51 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:51 devstack sudo[76814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:46:51 devstack sudo[76814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:52 devstack sudo[76814]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:52 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:52 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:52 devstack sudo[76817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:46:52 devstack sudo[76817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:52 devstack sudo[76817]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:52 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:52 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:52 devstack sudo[76820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:46:52 devstack sudo[76820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:53 devstack sudo[76820]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:53 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.634s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:53 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:53 devstack sudo[76823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:46:53 devstack sudo[76823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:54 devstack sudo[76823]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:54 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:54 devstack cinder-volume[75716]: DEBUG cinder.manager [None req-216f209c-6d17-4233-afda-231ce449586a None None] Notifying Schedulers of capabilities ... {{(pid=75716) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:46:54 devstack cinder-volume[75716]: INFO cinder.volume.manager [None req-216f209c-6d17-4233-afda-231ce449586a None None] Driver initialization completed successfully. Jul 03 13:46:54 devstack cinder-volume[75716]: INFO cinder.manager [None req-216f209c-6d17-4233-afda-231ce449586a None None] Initiating service 2 cleanup Jul 03 13:46:54 devstack cinder-volume[75716]: INFO cinder.manager [None req-216f209c-6d17-4233-afda-231ce449586a None None] Service 2 cleanup completed. Jul 03 13:46:54 devstack cinder-volume[75716]: DEBUG cinder.service [None req-216f209c-6d17-4233-afda-231ce449586a None None] Creating RPC server for service cinder-volume {{(pid=75716) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 13:46:54 devstack cinder-volume[75716]: DEBUG cinder.service [None req-216f209c-6d17-4233-afda-231ce449586a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75716) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 13:46:54 devstack cinder-volume[75716]: INFO cinder.volume.manager [None req-216f209c-6d17-4233-afda-231ce449586a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 03 13:46:54 devstack cinder-volume[75716]: DEBUG cinder.volume.drivers.lvm [None req-216f209c-6d17-4233-afda-231ce449586a None None] Updating volume stats {{(pid=75716) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 13:46:54 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:54 devstack sudo[76827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:46:54 devstack sudo[76827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:55 devstack sudo[76827]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:55 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:55 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:55 devstack sudo[76834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:46:55 devstack sudo[76834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:55 devstack sudo[76834]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:55 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.736s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:55 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:55 devstack sudo[76843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:46:55 devstack sudo[76843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:56 devstack sudo[76843]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:56 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:56 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:56 devstack sudo[76900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:46:56 devstack sudo[76900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:57 devstack sudo[76900]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:57 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-216f209c-6d17-4233-afda-231ce449586a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:57 devstack cinder-volume[75716]: INFO cinder.volume.manager [None req-216f209c-6d17-4233-afda-231ce449586a None None] Driver post RPC initialization completed successfully. Jul 03 13:47:07 devstack cinder-volume[75716]: DEBUG dbcounter [-] [75716] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75716) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:47:07 devstack cinder-volume[75716]: DEBUG dbcounter [-] [75716] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75716) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:48:19 devstack cinder-volume[75716]: DEBUG oslo_service.periodic_task [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75716) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:48:19 devstack cinder-volume[75716]: DEBUG cinder.volume.drivers.lvm [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Updating volume stats {{(pid=75716) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 13:48:19 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:19 devstack sudo[79211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:48:19 devstack sudo[79211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:19 devstack sudo[79211]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:19 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:19 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:19 devstack sudo[79214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:48:19 devstack sudo[79214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:20 devstack sudo[79214]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:20 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:20 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:20 devstack sudo[79217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:48:20 devstack sudo[79217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:21 devstack sudo[79217]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:21 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.635s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:21 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:21 devstack sudo[79220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:48:21 devstack sudo[79220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:21 devstack sudo[79220]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:21 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:21 devstack cinder-volume[75716]: DEBUG cinder.manager [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Notifying Schedulers of capabilities ... {{(pid=75716) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:49:07 devstack cinder-volume[75716]: DEBUG dbcounter [-] [75716] Writing DB stats cinder:SELECT=1 {{(pid=75716) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:49:07 devstack cinder-volume[75716]: DEBUG dbcounter [-] [75716] Writing DB stats cinder:UPDATE=1 {{(pid=75716) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:49:19 devstack cinder-volume[75716]: DEBUG oslo_service.periodic_task [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75716) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:49:19 devstack cinder-volume[75716]: DEBUG cinder.volume.drivers.lvm [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Updating volume stats {{(pid=75716) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 13:49:19 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:19 devstack sudo[82206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:49:19 devstack sudo[82206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:19 devstack sudo[82206]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:19 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:19 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:19 devstack sudo[82209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:49:19 devstack sudo[82209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:20 devstack sudo[82209]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:20 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:20 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:20 devstack sudo[82212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:49:20 devstack sudo[82212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:21 devstack sudo[82212]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:21 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:21 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:21 devstack sudo[82215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:49:21 devstack sudo[82215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:21 devstack sudo[82215]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:21 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:21 devstack cinder-volume[75716]: DEBUG cinder.manager [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Notifying Schedulers of capabilities ... {{(pid=75716) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:50:19 devstack cinder-volume[75716]: DEBUG oslo_service.periodic_task [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75716) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:50:19 devstack cinder-volume[75716]: DEBUG cinder.volume.drivers.lvm [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Updating volume stats {{(pid=75716) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 13:50:19 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:19 devstack sudo[84431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:50:19 devstack sudo[84431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:19 devstack sudo[84431]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:19 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:19 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:19 devstack sudo[84440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:50:19 devstack sudo[84440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:20 devstack sudo[84440]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:20 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:20 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:20 devstack sudo[84444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:50:20 devstack sudo[84444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:21 devstack sudo[84444]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:21 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.735s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:21 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:21 devstack sudo[84458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:50:21 devstack sudo[84458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:21 devstack sudo[84458]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:21 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:21 devstack cinder-volume[75716]: DEBUG cinder.manager [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Notifying Schedulers of capabilities ... {{(pid=75716) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:51:07 devstack cinder-volume[75716]: DEBUG dbcounter [-] [75716] Writing DB stats cinder:SELECT=1 {{(pid=75716) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:51:07 devstack cinder-volume[75716]: DEBUG dbcounter [-] [75716] Writing DB stats cinder:UPDATE=1 {{(pid=75716) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:51:19 devstack cinder-volume[75716]: DEBUG oslo_service.periodic_task [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75716) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:51:19 devstack cinder-volume[75716]: DEBUG cinder.volume.drivers.lvm [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Updating volume stats {{(pid=75716) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 13:51:19 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:19 devstack sudo[85611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:51:19 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:19 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:19 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:19 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:19 devstack sudo[85629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:51:19 devstack sudo[85629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:20 devstack sudo[85629]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:20 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:20 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:20 devstack sudo[85673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:51:20 devstack sudo[85673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:21 devstack sudo[85673]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:21 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.636s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:21 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:21 devstack sudo[85700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:51:21 devstack sudo[85700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:21 devstack sudo[85700]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:21 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:21 devstack cinder-volume[75716]: DEBUG cinder.manager [None req-7f518ab1-fc8e-42ac-8738-a68d286c77c2 None None] Notifying Schedulers of capabilities ... {{(pid=75716) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:51:22 devstack cinder-volume[75518]: INFO oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Caught SIGTERM, stopping children Jul 03 13:51:22 devstack cinder-volume[75518]: DEBUG oslo_concurrency.lockutils [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Acquiring lock "singleton_lock" {{(pid=75518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 13:51:22 devstack cinder-volume[75518]: DEBUG oslo_concurrency.lockutils [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Acquired lock "singleton_lock" {{(pid=75518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 13:51:22 devstack cinder-volume[75518]: DEBUG oslo_concurrency.lockutils [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Releasing lock "singleton_lock" {{(pid=75518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 13:51:22 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Stop services. {{(pid=75518) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 03 13:51:22 devstack cinder-volume[75518]: DEBUG oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Killing children. {{(pid=75518) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 03 13:51:22 devstack cinder-volume[75518]: INFO oslo_service.backend._eventlet.service [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Waiting on 1 children to exit Jul 03 13:51:27 devstack cinder-volume[75716]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 03 13:51:28 devstack cinder-volume[85855]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 13:51:28 devstack cinder-volume[85855]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 13:51:28 devstack cinder-volume[85855]: we strongly recommend against using it for new projects. Jul 03 13:51:28 devstack cinder-volume[85855]: If you are already using Eventlet, we recommend migrating to a different Jul 03 13:51:28 devstack cinder-volume[85855]: framework. For more detail see Jul 03 13:51:28 devstack cinder-volume[85855]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 13:51:28 devstack cinder-volume[85855]: import eventlet # noqa Jul 03 13:51:29 devstack cinder-volume[75716]: DEBUG oslo_concurrency.lockutils [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Acquiring lock "singleton_lock" {{(pid=75716) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 13:51:29 devstack cinder-volume[75716]: DEBUG oslo_concurrency.lockutils [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Acquired lock "singleton_lock" {{(pid=75716) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 13:51:29 devstack cinder-volume[75716]: DEBUG oslo_concurrency.lockutils [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Releasing lock "singleton_lock" {{(pid=75716) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 13:51:29 devstack cinder-volume[75716]: WARNING amqp [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 13:51:29 devstack cinder-volume[75716]: WARNING amqp [None req-2841d0a4-3439-40f3-bb4f-f3b0eb01b22b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 13:51:30 devstack cinder-volume[85855]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85855) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 13:51:30 devstack cinder-volume[85855]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85855) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 13:51:30 devstack cinder-volume[85855]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85855) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 13:51:31 devstack cinder-volume[85855]: INFO dbcounter [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Registered counter for database cinder Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_db.sqlalchemy.engines [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85855) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG dbcounter [-] [85855] Writer thread running {{(pid=85855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 13:51:31 devstack cinder-volume[85855]: INFO cinder.rpc [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 13:51:31 devstack cinder-volume[85855]: INFO cinder.rpc [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_db.sqlalchemy.engines [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85855) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:51:31 devstack cinder-volume[85855]: INFO cinder.volume.manager [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Determined volume DB was empty at startup. Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG cinder.volume.manager [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85855) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jul 03 13:51:31 devstack cinder-volume[85855]: INFO cinder.volume.manager [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 03 13:51:31 devstack cinder-volume[85855]: WARNING stevedore.named [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 13:51:31 devstack cinder-volume[85855]: WARNING castellan.key_manager [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 13:51:31 devstack cinder-volume[85855]: WARNING cinder.keymgr.conf_key_mgr [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 13:51:31 devstack cinder-volume[85855]: INFO cinder.volume.manager [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_db.sqlalchemy.engines [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85855) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:51:31 devstack cinder-volume[85855]: INFO oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Starting 1 workers Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Started child 86127 {{(pid=85855) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Full set of CONF: {{(pid=85855) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] ******************************************************************************** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Configuration options gathered from: {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] ================================================================================ {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 13:51:31 devstack cinder-volume[86127]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] allow_availability_zone_fallback = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] allow_compression_on_image_upload = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] allowed_direct_url_schemes = [] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] api_rate_limit = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] auth_strategy = keystone {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_availability_zone = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_host = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_name = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_stats_polling_interval = 60 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backup_api_class = cinder.backup.api.API {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backup_name_template = backup-%s {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backup_use_same_host = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backup_use_temp_snapshot = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] chap_password = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] chap_username = {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cinder_internal_tenant_project_id = 533e724de8294fe9824b72cfb16b9be7 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cinder_internal_tenant_user_id = cd86ff79191f479fa6b8391314719922 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cluster = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] compression_format = gzip {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] compute_api_class = cinder.compute.nova.API {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] config_dir = [] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] config_source = [] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] control_exchange = openstack {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] debug = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] default_availability_zone = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] default_group_type = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] default_volume_type = QuobyteHD {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] disk_geometry = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] driver_client_cert = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] driver_client_cert_key = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] driver_data_namespace = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] driver_ssl_cert_path = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:31 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] driver_ssl_cert_verify = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] driver_use_ssl = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] enable_new_services = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] enable_unsupported_driver = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] enabled_backends = ['QuobyteHD'] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] enforce_multipath_for_image_xfer = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] filter_function = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance_api_insecure = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance_api_servers = ['http://192.168.122.214/image'] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance_api_ssl_compression = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance_ca_certificates_file = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance_catalog_info = image:glance:publicURL {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance_certfile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance_keyfile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance_num_retries = 3 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance_request_timeout = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] goodness_function = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] graceful_shutdown_timeout = 5 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] group_api_class = cinder.group.api.API {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] host = devstack {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] image_compress_on_upload = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] image_conversion_address_space_limit = 1 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] image_conversion_cpu_limit = 60 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] image_conversion_disable = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] image_upload_use_cinder_backend = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] image_upload_use_internal_tenant = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] image_volume_cache_enabled = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] image_volume_cache_max_count = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] image_volume_cache_max_size_gb = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] init_host_max_objects_retrieval = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] instance_format = [instance: %(uuid)s] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] iscsi_target_flags = {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] iscsi_write_cache = on {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] iser_helper = tgtadm {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[86127]: INFO cinder.volume.manager [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 03 13:51:32 devstack cinder-volume[86127]: DEBUG cinder.volume.drivers.remotefs [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86127) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] iser_ip_address = 192.168.122.214 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] iser_port = 3260 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] log_color = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] log_config_append = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] log_dir = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] log_file = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] log_options = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] log_rotate_interval = 1 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] log_rotate_interval_type = days {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] log_rotation_type = none {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] max_age = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] max_logfile_count = 30 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] max_logfile_size_mb = 200 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] max_over_subscription_ratio = 20.0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] message_reap_interval = 86400 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] message_ttl = 2592000 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] migration_create_volume_timeout_secs = 300 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] monkey_patch = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] monkey_patch_modules = [] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] my_ip = 192.168.122.214 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] no_snapshot_gb_quota = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] num_iser_scan_tries = 3 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] num_shell_tries = 3 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] num_volume_device_scan_tries = 3 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] nvmeof_conn_info_version = 1 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] nvmet_ns_id = 10 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] nvmet_port_id = 1 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] osapi_max_limit = 1000 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] osapi_volume_ext_list = [] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] osapi_volume_listen = 0.0.0.0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] osapi_volume_listen_port = 8776 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] osapi_volume_use_ssl = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] osapi_volume_workers = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] per_volume_size_limit = -1 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] periodic_fuzzy_delay = 60 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] periodic_interval = 60 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] project_id_regex = [0-9a-f\-]+ {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] public_endpoint = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] publish_errors = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] quota_backup_gigabytes = 1000 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] quota_backups = 10 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] quota_gigabytes = 1000 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] quota_groups = 10 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] quota_snapshots = 10 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[86127]: DEBUG cinder.volume.drivers.quobyte [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86127) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 03 13:51:32 devstack cinder-volume[86127]: WARNING cinder.volume.drivers.quobyte [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 03 13:51:32 devstack cinder-volume[86127]: WARNING cinder.volume.drivers.quobyte [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] quota_volumes = 10 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] rate_limit_burst = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] rate_limit_except_level = CRITICAL {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] rate_limit_interval = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] reinit_driver_count = 3 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] replication_device = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] report_discard_supported = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] report_interval = 120 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[86127]: DEBUG oslo_concurrency.processutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Running cmd (subprocess): mount.quobyte {{(pid=86127) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] reservation_clean_interval = 86400 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] reservation_expire = 86400 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] reserved_image_namespaces = [] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] reserved_percentage = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] rpc_response_timeout = 120 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] run_external_periodic_tasks = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] scst_target_driver = iscsi {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] scst_target_iqn_name = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] service_down_time = 720 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] shell_completion = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] snapshot_name_template = snapshot-%s {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] split_loggers = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] state_path = /opt/stack/data/cinder {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] storage_availability_zone = nova {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] storage_protocol = iSCSI {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] syslog_log_facility = LOG_USER {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] target_helper = lioadm {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] target_ip_address = 192.168.122.214 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] target_port = 3260 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] target_protocol = iscsi {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] target_secondary_ip_addresses = [] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] trace_flags = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] transfer_api_class = cinder.transfer.api.API {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] transport_url = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] until_refresh = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] use_chap_auth = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] use_default_quota_class = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] use_journal = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] use_json = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] use_multipath_for_image_xfer = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] use_stderr = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] use_syslog = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] verify_glance_signatures = enabled {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] volume_api_class = cinder.volume.api.API {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] volume_backend_name = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] volume_clear = zero {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] volume_clear_ionice = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] volume_clear_size = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] volume_copy_bps_limit = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] volume_dd_blocksize = 1M {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] volume_name_template = volume-%s {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] volume_service_inithost_offload = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] volume_usage_audit_period = month {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] zoning_mode = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_concurrency.disable_process_locking = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.auth_section = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.auth_type = password {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.auth_version = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.cache = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.certfile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.delay_auth_decision = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.http_connect_timeout = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.include_service_catalog = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.insecure = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.interface = public {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.keyfile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.memcache_password = {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.memcache_username = {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.region_name = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.service_token_roles_required = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.service_type = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.token_cache_time = 300 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.214/identity {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.backend = dogpile.cache.null {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.backend_argument = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.backend_expiration_time = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.config_prefix = cache.oslo {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.debug_cache_backend = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.enable_retry_client = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.enable_socket_keepalive = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.enabled = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.expiration_time = 600 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.hashclient_retry_attempts = 2 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.memcache_dead_retry = 300 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.memcache_pool_maxsize = 10 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.memcache_sasl_enabled = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.password = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.proxies = [] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.redis_db = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.redis_sentinel_service_name = mymaster {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.redis_server = localhost:6379 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.retry_attempts = 2 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.retry_delay = 0.0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.socket_keepalive_count = 1 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.socket_keepalive_idle = 1 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.socket_keepalive_interval = 1 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.socket_timeout = 1.0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.tls_allowed_ciphers = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.tls_cafile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.tls_certfile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.tls_enabled = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.tls_keyfile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cache.username = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] coordination.backend_url = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.asyncio_connection = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.asyncio_slave_connection = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.backend = sqlalchemy {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.connection = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.connection_debug = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.connection_parameters = {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.connection_recycle_time = 3600 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.connection_trace = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.db_inc_retry_interval = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.db_max_retries = 20 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.db_max_retry_interval = 10 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.db_retry_interval = 1 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.max_overflow = 50 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.max_pool_size = 5 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.max_retries = 10 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.mysql_wsrep_sync_wait = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.pool_timeout = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.retry_interval = 10 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.slave_connection = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.sqlite_synchronous = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.synchronous_reader = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] database.use_db_reconnect = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] profiler.connection_string = messaging:// {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] profiler.enabled = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] profiler.es_doc_type = notification {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] profiler.es_scroll_size = 10000 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] profiler.es_scroll_time = 2m {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] profiler.filter_error_trace = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] profiler.hmac_keys = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] profiler.sentinel_service_name = mymaster {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] profiler.socket_timeout = 0.1 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] profiler.trace_requests = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] profiler.trace_sqlalchemy = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] profiler_jaeger.process_tags = {} {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] profiler_jaeger.service_name_prefix = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] profiler_otlp.service_name_prefix = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_policy.enforce_new_defaults = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_policy.enforce_scope = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_policy.policy_default_rule = default {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_policy.policy_file = policy.yaml {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_policy.remote_timeout = 60.0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] privsep_osbrick.group = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] privsep_osbrick.helper_command = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] privsep_osbrick.user = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cinder_sys_admin.group = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cinder_sys_admin.helper_command = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] cinder_sys_admin.user = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] service_user.auth_section = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] service_user.auth_type = password {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] service_user.cafile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] service_user.certfile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] service_user.collect_timing = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] service_user.insecure = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] service_user.keyfile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] service_user.send_service_user_token = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] service_user.split_loggers = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] service_user.timeout = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance.auth_section = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance.auth_type = password {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance.certfile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance.collect_timing = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance.insecure = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance.keyfile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance.region_name = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance.split_loggers = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] glance.timeout = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.backend_availability_zone = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.chap_password = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.chap_username = {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack quobyte-client[86139]: Reading configuration file: /etc/quobyte/client.cfg Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.disk_geometry = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.driver_client_cert = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.driver_client_cert_key = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.driver_data_namespace = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack quobyte-client[86139]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.driver_use_ssl = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.enable_unsupported_driver = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.extra_capabilities = {} {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.filter_function = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.goodness_function = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.iscsi_target_flags = {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.iscsi_write_cache = on {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.iser_helper = tgtadm {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.iser_ip_address = 192.168.122.214 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.iser_port = 3260 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.nas_host = {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.nas_login = admin {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.nas_mount_options = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.nas_password = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.nas_private_key = {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.nas_share_path = {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.nas_ssh_port = 22 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.num_shell_tries = 3 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[86127]: DEBUG oslo_concurrency.processutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] CMD "mount.quobyte" returned: 1 in 0.120s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.nvmet_port_id = 1 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[86127]: DEBUG oslo_concurrency.lockutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86127) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.quobyte_client_cfg = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[86127]: DEBUG oslo_concurrency.lockutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86127) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[86127]: DEBUG cinder.volume.drivers.quobyte [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86127) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:32 devstack cinder-volume[86127]: INFO cinder.volume.drivers.quobyte [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 ... Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[86127]: DEBUG oslo_concurrency.processutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce -c /etc/quobyte/client-cinder.cfg {{(pid=86127) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.quobyte_volume_url = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.replication_device = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.report_discard_supported = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.reserved_percentage = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.scst_target_driver = iscsi {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.scst_target_iqn_name = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.storage_protocol = iSCSI {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.target_helper = tgtadm {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.target_ip_address = 192.168.122.214 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.target_port = 3260 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.target_protocol = iscsi {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.trace_flags = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.unique_fqdn_network = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.use_chap_auth = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.volume_backend_name = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.volume_clear = zero {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.volume_clear_ionice = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.volume_clear_size = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_reports.file_event_handler = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_reports.log_dir = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.backend_availability_zone = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.backend_host = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.chap_password = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.chap_username = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.chiscsi_conf = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.disk_geometry = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.driver_client_cert = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.driver_client_cert_key = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.driver_data_namespace = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.driver_use_ssl = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.extra_capabilities = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.filter_function = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.goodness_function = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.iscsi_target_flags = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.iscsi_write_cache = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.iser_helper = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.iser_ip_address = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.iser_port = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.iser_target_prefix = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.nas_host = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.nas_login = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.nas_mount_options = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.nas_password = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.nas_private_key = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.nas_share_path = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.nas_ssh_port = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.num_shell_tries = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.nvmet_ns_id = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.nvmet_port_id = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.replication_device = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.report_discard_supported = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.reserved_percentage = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.scst_target_driver = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.storage_protocol = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.target_helper = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.target_ip_address = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.target_port = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack sudo[86140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce -c /etc/quobyte/client-cinder.cfg Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.target_prefix = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.target_protocol = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.trace_flags = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.unique_fqdn_network = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack sudo[86140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.use_chap_auth = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.volume_clear = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.volume_clear_ionice = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.volume_clear_size = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] QuobyteHD.volumes_dir = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.ssl = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.ssl_version = {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_notifications.driver = [] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_notifications.retry = -1 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] oslo_messaging_notifications.transport_url = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] key_manager.fixed_key = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican.barbican_api_version = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican.barbican_endpoint = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican.barbican_endpoint_type = public {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican.barbican_region_name = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican.cafile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican.certfile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican.collect_timing = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican.insecure = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican.keyfile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican.number_of_retries = 60 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican.retry_delay = 1 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican.send_service_user_token = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican.split_loggers = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican.timeout = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican.verify_ssl = True {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican.verify_ssl_path = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican_service_user.auth_section = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican_service_user.auth_type = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican_service_user.cafile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican_service_user.certfile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican_service_user.collect_timing = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican_service_user.insecure = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican_service_user.keyfile = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican_service_user.split_loggers = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] barbican_service_user.timeout = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] vault.approle_role_id = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] vault.approle_secret_id = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] vault.kv_mountpoint = secret {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] vault.kv_path = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] vault.kv_version = 2 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] vault.namespace = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] vault.root_token_id = **** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] vault.ssl_ca_crt_file = None {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] vault.timeout = 60.0 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] vault.use_ssl = False {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:32 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] ******************************************************************************** {{(pid=85855) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 13:51:33 devstack sudo[86140]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:33 devstack cinder-volume[86127]: DEBUG oslo_concurrency.processutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.866s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:33 devstack cinder-volume[86127]: INFO cinder.volume.drivers.quobyte [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 succeeded Jul 03 13:51:33 devstack cinder-volume[86127]: DEBUG cinder.volume.drivers.quobyte [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86127) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:33 devstack cinder-volume[86127]: DEBUG oslo_concurrency.lockutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.875s {{(pid=86127) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:33 devstack cinder-volume[86127]: DEBUG oslo_concurrency.processutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86127) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:33 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:51:33 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:33 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:33 devstack cinder-volume[86127]: DEBUG oslo_concurrency.processutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.643s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:33 devstack cinder-volume[86127]: INFO cinder.volume.driver [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Driver hasn't implemented _init_vendor_properties() Jul 03 13:51:33 devstack cinder-volume[86127]: DEBUG cinder.volume.driver [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7272872924805, 'free_capacity_gb': 1775.7272872924805, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86127) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jul 03 13:51:33 devstack cinder-volume[86127]: DEBUG oslo_db.sqlalchemy.engines [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86127) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:51:33 devstack cinder-volume[86127]: DEBUG dbcounter [-] [86127] Writer thread running {{(pid=86127) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 13:51:33 devstack cinder-volume[86127]: DEBUG cinder.db.sqlalchemy.api [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Building query based on filter {{(pid=86127) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jul 03 13:51:33 devstack cinder-volume[86127]: DEBUG cinder.image.image_utils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86127) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jul 03 13:51:33 devstack cinder-volume[86127]: INFO cinder.keymgr.migration [None req-037beea7-1dc9-44ad-8abb-707aa731792c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 13:51:33 devstack cinder-volume[86127]: DEBUG oslo_concurrency.lockutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86127) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:33 devstack cinder-volume[86127]: DEBUG oslo_concurrency.lockutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86127) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:33 devstack cinder-volume[86127]: DEBUG cinder.volume.drivers.quobyte [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86127) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:33 devstack cinder-volume[86127]: DEBUG cinder.volume.drivers.quobyte [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86127) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:33 devstack cinder-volume[86127]: DEBUG oslo_concurrency.lockutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86127) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:33 devstack cinder-volume[86127]: DEBUG oslo_concurrency.processutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86127) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:33 devstack sudo[86244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:51:33 devstack sudo[86244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:34 devstack sudo[86244]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:34 devstack cinder-volume[86127]: DEBUG oslo_concurrency.processutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.664s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:34 devstack cinder-volume[86127]: DEBUG cinder.manager [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Notifying Schedulers of capabilities ... {{(pid=86127) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:51:34 devstack cinder-volume[86127]: INFO cinder.volume.manager [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Driver initialization completed successfully. Jul 03 13:51:34 devstack cinder-volume[86127]: INFO cinder.manager [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Initiating service 3 cleanup Jul 03 13:51:34 devstack cinder-volume[86127]: INFO cinder.manager [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Service 3 cleanup completed. Jul 03 13:51:34 devstack cinder-volume[86127]: DEBUG cinder.service [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Creating RPC server for service cinder-volume {{(pid=86127) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 13:51:34 devstack cinder-volume[86127]: DEBUG cinder.service [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86127) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 13:51:34 devstack cinder-volume[86127]: INFO cinder.volume.manager [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 03 13:51:34 devstack cinder-volume[86127]: DEBUG oslo_concurrency.lockutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86127) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:34 devstack cinder-volume[86127]: DEBUG oslo_concurrency.lockutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86127) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:34 devstack cinder-volume[86127]: DEBUG cinder.volume.drivers.quobyte [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86127) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:34 devstack cinder-volume[86127]: DEBUG cinder.volume.drivers.quobyte [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86127) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:34 devstack cinder-volume[86127]: DEBUG oslo_concurrency.lockutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86127) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:34 devstack cinder-volume[86127]: DEBUG oslo_concurrency.processutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86127) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:34 devstack sudo[86266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:51:34 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:35 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:35 devstack cinder-volume[86127]: DEBUG oslo_concurrency.processutils [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.702s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:35 devstack cinder-volume[86127]: INFO cinder.volume.manager [None req-e6a17cec-a512-42ce-9350-d7671e8bb7f4 None None] Driver post RPC initialization completed successfully. Jul 03 13:51:39 devstack cinder-volume[86127]: DEBUG oslo_concurrency.lockutils [None req-b97bec28-6686-4cb7-b644-5a673d485e40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86127) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:39 devstack cinder-volume[86127]: DEBUG oslo_concurrency.lockutils [None req-b97bec28-6686-4cb7-b644-5a673d485e40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86127) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:39 devstack cinder-volume[86127]: DEBUG cinder.volume.drivers.quobyte [None req-b97bec28-6686-4cb7-b644-5a673d485e40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86127) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:39 devstack cinder-volume[86127]: DEBUG cinder.volume.drivers.quobyte [None req-b97bec28-6686-4cb7-b644-5a673d485e40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86127) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:39 devstack cinder-volume[86127]: DEBUG oslo_concurrency.lockutils [None req-b97bec28-6686-4cb7-b644-5a673d485e40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86127) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:39 devstack cinder-volume[86127]: DEBUG oslo_concurrency.processutils [None req-b97bec28-6686-4cb7-b644-5a673d485e40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86127) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:39 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:51:39 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:40 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:40 devstack cinder-volume[86127]: DEBUG oslo_concurrency.processutils [None req-b97bec28-6686-4cb7-b644-5a673d485e40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.626s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:40 devstack cinder-volume[86127]: DEBUG cinder.manager [None req-b97bec28-6686-4cb7-b644-5a673d485e40 None None] Notifying Schedulers of capabilities ... {{(pid=86127) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:51:41 devstack cinder-volume[85855]: DEBUG dbcounter [-] [85855] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:51:42 devstack cinder-volume[85855]: INFO oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Caught SIGTERM, stopping children Jul 03 13:51:42 devstack cinder-volume[85855]: DEBUG oslo_concurrency.lockutils [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Acquiring lock "singleton_lock" {{(pid=85855) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 13:51:42 devstack cinder-volume[85855]: DEBUG oslo_concurrency.lockutils [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Acquired lock "singleton_lock" {{(pid=85855) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 13:51:42 devstack cinder-volume[85855]: DEBUG oslo_concurrency.lockutils [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Releasing lock "singleton_lock" {{(pid=85855) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 13:51:42 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Stop services. {{(pid=85855) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 03 13:51:42 devstack cinder-volume[85855]: DEBUG oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Killing children. {{(pid=85855) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 03 13:51:42 devstack cinder-volume[85855]: INFO oslo_service.backend._eventlet.service [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Waiting on 1 children to exit Jul 03 13:51:45 devstack cinder-volume[86127]: DEBUG dbcounter [-] [86127] Writing DB stats cinder:SELECT=3 {{(pid=86127) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:51:45 devstack cinder-volume[86127]: DEBUG dbcounter [-] [86127] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86127) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:51:47 devstack cinder-volume[86127]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 03 13:51:48 devstack cinder-volume[86127]: DEBUG oslo_concurrency.lockutils [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Acquiring lock "singleton_lock" {{(pid=86127) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 13:51:48 devstack cinder-volume[86127]: DEBUG oslo_concurrency.lockutils [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Acquired lock "singleton_lock" {{(pid=86127) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 13:51:48 devstack cinder-volume[86127]: DEBUG oslo_concurrency.lockutils [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Releasing lock "singleton_lock" {{(pid=86127) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 13:51:48 devstack cinder-volume[86127]: WARNING amqp [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 13:51:48 devstack cinder-volume[86127]: WARNING amqp [None req-64835e3a-00a8-475a-bf31-b195d58a7c9f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 13:51:48 devstack cinder-volume[86564]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 13:51:48 devstack cinder-volume[86564]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 13:51:48 devstack cinder-volume[86564]: we strongly recommend against using it for new projects. Jul 03 13:51:48 devstack cinder-volume[86564]: If you are already using Eventlet, we recommend migrating to a different Jul 03 13:51:48 devstack cinder-volume[86564]: framework. For more detail see Jul 03 13:51:48 devstack cinder-volume[86564]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 13:51:48 devstack cinder-volume[86564]: import eventlet # noqa Jul 03 13:51:50 devstack cinder-volume[86564]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86564) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 13:51:50 devstack cinder-volume[86564]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86564) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 13:51:50 devstack cinder-volume[86564]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86564) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 13:51:51 devstack cinder-volume[86564]: INFO dbcounter [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] Registered counter for database cinder Jul 03 13:51:51 devstack cinder-volume[86564]: DEBUG oslo_db.sqlalchemy.engines [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86564) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:51:51 devstack cinder-volume[86564]: DEBUG dbcounter [-] [86564] Writer thread running {{(pid=86564) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 13:51:51 devstack cinder-volume[86564]: INFO cinder.rpc [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 13:51:51 devstack cinder-volume[86564]: INFO cinder.rpc [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 13:51:51 devstack cinder-volume[86564]: DEBUG oslo_db.sqlalchemy.engines [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86564) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:51:51 devstack cinder-volume[86564]: INFO cinder.volume.manager [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] Determined volume DB was empty at startup. Jul 03 13:51:51 devstack cinder-volume[86564]: DEBUG cinder.volume.manager [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86564) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jul 03 13:51:51 devstack cinder-volume[86564]: WARNING stevedore.named [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 13:51:51 devstack cinder-volume[86564]: WARNING castellan.key_manager [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 13:51:51 devstack cinder-volume[86564]: WARNING cinder.keymgr.conf_key_mgr [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 13:51:51 devstack cinder-volume[86564]: INFO cinder.volume.manager [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 03 13:51:51 devstack cinder-volume[86564]: DEBUG oslo_db.sqlalchemy.engines [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86564) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:51:51 devstack cinder-volume[86564]: INFO oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] Starting 1 workers Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] Started child 86805 {{(pid=86564) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] Full set of CONF: {{(pid=86564) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] ******************************************************************************** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] Configuration options gathered from: {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 13:51:52 devstack cinder-volume[86805]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] ================================================================================ {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] allow_availability_zone_fallback = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] allow_compression_on_image_upload = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] allowed_direct_url_schemes = [] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] api_rate_limit = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] auth_strategy = keystone {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_availability_zone = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_host = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_name = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_stats_polling_interval = 60 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backup_api_class = cinder.backup.api.API {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backup_name_template = backup-%s {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backup_use_same_host = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backup_use_temp_snapshot = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] chap_password = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] chap_username = {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cinder_internal_tenant_project_id = 533e724de8294fe9824b72cfb16b9be7 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cinder_internal_tenant_user_id = cd86ff79191f479fa6b8391314719922 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cluster = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] compression_format = gzip {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] compute_api_class = cinder.compute.nova.API {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] config_dir = [] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] config_source = [] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] control_exchange = openstack {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] debug = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] default_availability_zone = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] default_group_type = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] default_volume_type = QuobyteHD {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] disk_geometry = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] driver_client_cert = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] driver_client_cert_key = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] driver_data_namespace = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] driver_ssl_cert_path = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] driver_ssl_cert_verify = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] driver_use_ssl = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] enable_new_services = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] enable_unsupported_driver = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] enabled_backends = ['QuobyteHD'] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] enforce_multipath_for_image_xfer = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] filter_function = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance_api_insecure = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance_api_servers = ['http://192.168.122.214/image'] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance_api_ssl_compression = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance_ca_certificates_file = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance_catalog_info = image:glance:publicURL {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance_certfile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance_keyfile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance_num_retries = 3 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance_request_timeout = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] goodness_function = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] graceful_shutdown_timeout = 5 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] group_api_class = cinder.group.api.API {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] host = devstack {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] image_compress_on_upload = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] image_conversion_address_space_limit = 1 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] image_conversion_cpu_limit = 60 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] image_conversion_disable = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] image_upload_use_cinder_backend = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] image_upload_use_internal_tenant = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] image_volume_cache_enabled = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] image_volume_cache_max_count = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] image_volume_cache_max_size_gb = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] init_host_max_objects_retrieval = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] instance_format = [instance: %(uuid)s] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] iscsi_target_flags = {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] iscsi_write_cache = on {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] iser_helper = tgtadm {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] iser_ip_address = 192.168.122.214 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] iser_port = 3260 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] log_color = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] log_config_append = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] log_dir = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] log_file = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] log_options = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] log_rotate_interval = 1 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] log_rotate_interval_type = days {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] log_rotation_type = none {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] max_age = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] max_logfile_count = 30 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] max_logfile_size_mb = 200 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] max_over_subscription_ratio = 20.0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Starting volume driver QuobyteDriver (1.1.14) Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] message_reap_interval = 86400 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86805) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] message_ttl = 2592000 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] migration_create_volume_timeout_secs = 300 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] monkey_patch = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] monkey_patch_modules = [] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] my_ip = 192.168.122.214 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] no_snapshot_gb_quota = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] num_iser_scan_tries = 3 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] num_shell_tries = 3 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] num_volume_device_scan_tries = 3 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] nvmeof_conn_info_version = 1 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] nvmet_ns_id = 10 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] nvmet_port_id = 1 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] osapi_max_limit = 1000 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] osapi_volume_ext_list = [] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] osapi_volume_listen_port = 8776 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] osapi_volume_use_ssl = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] osapi_volume_workers = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] per_volume_size_limit = -1 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] periodic_fuzzy_delay = 60 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] periodic_interval = 60 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] public_endpoint = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] publish_errors = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] quota_backup_gigabytes = 1000 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] quota_backups = 10 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] quota_gigabytes = 1000 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] quota_groups = 10 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] quota_snapshots = 10 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] quota_volumes = 10 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] rate_limit_burst = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] rate_limit_except_level = CRITICAL {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] rate_limit_interval = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] reinit_driver_count = 3 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] replication_device = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] report_discard_supported = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] report_interval = 120 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] reservation_clean_interval = 86400 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] reservation_expire = 86400 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] reserved_image_namespaces = [] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] reserved_percentage = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] rpc_response_timeout = 120 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] run_external_periodic_tasks = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] scst_target_driver = iscsi {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] scst_target_iqn_name = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] service_down_time = 720 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] shell_completion = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] snapshot_name_template = snapshot-%s {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] split_loggers = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] state_path = /opt/stack/data/cinder {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] storage_availability_zone = nova {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] storage_protocol = iSCSI {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] syslog_log_facility = LOG_USER {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] target_helper = lioadm {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] target_ip_address = 192.168.122.214 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] target_port = 3260 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] target_protocol = iscsi {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] target_secondary_ip_addresses = [] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] trace_flags = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] transport_url = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] until_refresh = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] use_chap_auth = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] use_default_quota_class = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] use_journal = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] use_json = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] use_multipath_for_image_xfer = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] use_stderr = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] use_syslog = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] verify_glance_signatures = enabled {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] volume_api_class = cinder.volume.api.API {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] volume_backend_name = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] volume_clear = zero {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] volume_clear_ionice = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] volume_clear_size = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] volume_copy_bps_limit = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] volume_dd_blocksize = 1M {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] volume_name_template = volume-%s {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] volume_service_inithost_offload = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] volume_usage_audit_period = month {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] zoning_mode = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_concurrency.disable_process_locking = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.auth_section = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.auth_type = password {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.auth_version = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.cache = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.certfile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.include_service_catalog = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.insecure = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.interface = public {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.keyfile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.memcache_password = {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.memcache_username = {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.region_name = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.service_type = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.214/identity {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.backend = dogpile.cache.null {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.backend_argument = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.backend_expiration_time = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.config_prefix = cache.oslo {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.debug_cache_backend = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.enable_retry_client = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.enable_socket_keepalive = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.enabled = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.expiration_time = 600 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.hashclient_retry_attempts = 2 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.memcache_dead_retry = 300 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.memcache_pool_maxsize = 10 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.memcache_sasl_enabled = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.password = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.proxies = [] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.redis_db = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86805) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.quobyte [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.redis_server = localhost:6379 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.quobyte [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.retry_attempts = 2 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.retry_delay = 0.0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.socket_keepalive_count = 1 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.socket_keepalive_idle = 1 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.socket_keepalive_interval = 1 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.socket_timeout = 1.0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.tls_allowed_ciphers = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.tls_cafile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.tls_certfile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Running cmd (subprocess): mount.quobyte {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.tls_enabled = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.tls_keyfile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cache.username = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] coordination.backend_url = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.asyncio_connection = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.asyncio_slave_connection = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.backend = sqlalchemy {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.connection = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.connection_debug = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.connection_parameters = {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.connection_recycle_time = 3600 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.connection_trace = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.db_inc_retry_interval = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.db_max_retries = 20 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.db_max_retry_interval = 10 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.db_retry_interval = 1 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.max_overflow = 50 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.max_pool_size = 5 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.max_retries = 10 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.mysql_wsrep_sync_wait = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.pool_timeout = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.retry_interval = 10 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.slave_connection = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.sqlite_synchronous = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.synchronous_reader = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] database.use_db_reconnect = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] profiler.connection_string = messaging:// {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] profiler.enabled = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] profiler.es_doc_type = notification {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] profiler.es_scroll_size = 10000 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] profiler.es_scroll_time = 2m {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] profiler.filter_error_trace = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] profiler.hmac_keys = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] profiler.sentinel_service_name = mymaster {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] profiler.socket_timeout = 0.1 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] profiler.trace_requests = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] profiler.trace_sqlalchemy = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] profiler_jaeger.process_tags = {} {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] profiler_jaeger.service_name_prefix = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] profiler_otlp.service_name_prefix = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_policy.enforce_new_defaults = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_policy.enforce_scope = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_policy.policy_default_rule = default {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_policy.policy_file = policy.yaml {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] privsep_osbrick.group = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] privsep_osbrick.helper_command = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] privsep_osbrick.user = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cinder_sys_admin.group = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cinder_sys_admin.helper_command = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] cinder_sys_admin.user = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] service_user.auth_section = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] service_user.auth_type = password {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] service_user.cafile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] service_user.certfile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] service_user.collect_timing = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] service_user.insecure = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] service_user.keyfile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] service_user.send_service_user_token = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] service_user.split_loggers = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] service_user.timeout = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance.auth_section = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance.auth_type = password {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance.certfile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance.collect_timing = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance.insecure = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance.keyfile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance.region_name = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance.split_loggers = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] glance.timeout = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.backend_availability_zone = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.chap_password = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.chap_username = {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.disk_geometry = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.driver_client_cert = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.driver_client_cert_key = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.driver_data_namespace = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.driver_use_ssl = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.extra_capabilities = {} {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.filter_function = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.goodness_function = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.iscsi_target_flags = {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.iscsi_write_cache = on {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.iser_helper = tgtadm {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.iser_ip_address = 192.168.122.214 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.iser_port = 3260 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.nas_host = {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.nas_login = admin {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.nas_mount_options = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.nas_password = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.nas_private_key = {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.nas_share_path = {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.num_shell_tries = 3 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack quobyte-client[86806]: Reading configuration file: /etc/quobyte/client.cfg Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack quobyte-client[86806]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.quobyte_volume_url = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.replication_device = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.report_discard_supported = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.reserved_percentage = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.target_helper = tgtadm {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.target_ip_address = 192.168.122.214 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.target_port = 3260 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.target_protocol = iscsi {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.trace_flags = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.unique_fqdn_network = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.use_chap_auth = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.volume_backend_name = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.volume_clear = zero {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.volume_clear_ionice = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.volume_clear_size = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_reports.file_event_handler = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_reports.log_dir = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.backend_availability_zone = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.backend_host = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.chap_password = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.chap_username = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.chiscsi_conf = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.disk_geometry = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.driver_client_cert = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.driver_data_namespace = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.driver_use_ssl = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.extra_capabilities = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.filter_function = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.goodness_function = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.iser_helper = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.iser_ip_address = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.iser_port = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.iser_target_prefix = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.nas_host = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.nas_login = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.nas_mount_options = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.nas_password = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.nas_private_key = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.nas_share_path = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.nas_ssh_port = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.num_shell_tries = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.nvmet_port_id = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.replication_device = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.report_discard_supported = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.reserved_percentage = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.scst_target_driver = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.storage_protocol = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.target_helper = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.target_ip_address = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.target_port = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.target_prefix = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.target_protocol = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.trace_flags = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.use_chap_auth = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.volume_clear = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.volume_clear_size = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] QuobyteHD.volumes_dir = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack sudo[86808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.ssl = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_notifications.driver = [] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_notifications.retry = -1 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] key_manager.fixed_key = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican.barbican_api_version = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican.barbican_endpoint = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican.barbican_endpoint_type = public {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican.barbican_region_name = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican.cafile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican.certfile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican.collect_timing = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican.insecure = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican.keyfile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican.number_of_retries = 60 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican.retry_delay = 1 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican.send_service_user_token = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican.split_loggers = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican.timeout = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican.verify_ssl = True {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican.verify_ssl_path = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican_service_user.auth_section = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican_service_user.auth_type = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican_service_user.cafile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican_service_user.certfile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican_service_user.collect_timing = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican_service_user.insecure = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican_service_user.keyfile = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican_service_user.split_loggers = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] barbican_service_user.timeout = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] vault.approle_role_id = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] vault.approle_secret_id = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] vault.kv_mountpoint = secret {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] vault.kv_path = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] vault.kv_version = 2 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] vault.namespace = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] vault.root_token_id = **** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] vault.ssl_ca_crt_file = None {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] vault.timeout = 60.0 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] vault.use_ssl = False {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:51:52 devstack cinder-volume[86564]: DEBUG oslo_service.backend._eventlet.service [None req-7e277a4d-1901-4ff1-a405-58707103942e None None] ******************************************************************************** {{(pid=86564) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 13:51:52 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.608s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:52 devstack cinder-volume[86805]: INFO cinder.volume.driver [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Driver hasn't implemented _init_vendor_properties() Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG cinder.volume.driver [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7272872924805, 'free_capacity_gb': 1775.7272872924805, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86805) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG oslo_db.sqlalchemy.engines [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86805) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writer thread running {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG cinder.db.sqlalchemy.api [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Building query based on filter {{(pid=86805) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86805) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:52 devstack cinder-volume[86805]: INFO cinder.keymgr.migration [None req-a13597b2-e607-451c-b126-0750172e3ed7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 13:51:52 devstack sudo[86815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:51:52 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:53 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.635s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:53 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:51:53 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Driver initialization completed successfully. Jul 03 13:51:53 devstack cinder-volume[86805]: INFO cinder.manager [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Initiating service 3 cleanup Jul 03 13:51:53 devstack cinder-volume[86805]: INFO cinder.manager [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Service 3 cleanup completed. Jul 03 13:51:53 devstack cinder-volume[86805]: DEBUG cinder.service [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Creating RPC server for service cinder-volume {{(pid=86805) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 13:51:53 devstack cinder-volume[86805]: DEBUG cinder.service [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86805) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 13:51:53 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 03 13:51:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:53 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:51:53 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:54 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.641s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:54 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-19849cbc-d829-4e8e-bcbf-8b5f565522cd None None] Driver post RPC initialization completed successfully. Jul 03 13:52:01 devstack cinder-volume[86564]: DEBUG dbcounter [-] [86564] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86564) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:52:03 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=1 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:52:04 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:52:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:52:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:52:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:52:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:58 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:52:58 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:59 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.700s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Flow 'volume_create_manager' (4fc47c9b-a09f-4326-bf8b-64cf6b945052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a26c91-b3d6-40e2-b69e-85f2625296b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a26c91-b3d6-40e2-b69e-85f2625296b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-422198701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010ecf53-144c-46dc-a489-594823e41adf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9380b83f10439fa7024e69d59db818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:25Z,use_quota=True,user_id='19568084c7264759a0c6d4e701239b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77808554-e785-4a98-9baf-989d5f98baf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77808554-e785-4a98-9baf-989d5f98baf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5627887-c60d-4fba-afd5-a6c3a112ed09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5627887-c60d-4fba-afd5-a6c3a112ed09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010ecf53-144c-46dc-a489-594823e41adf', 'volume_name': 'volume-010ecf53-144c-46dc-a489-594823e41adf', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deeecd3b-cd4b-434e-9a9d-c47f14698155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deeecd3b-cd4b-434e-9a9d-c47f14698155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b862b6b7-9812-4b3b-b640-715192c3c008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:25 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Volume 010ecf53-144c-46dc-a489-594823e41adf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010ecf53-144c-46dc-a489-594823e41adf', 'volume_size': 1} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-422198701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010ecf53-144c-46dc-a489-594823e41adf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9380b83f10439fa7024e69d59db818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:25Z,use_quota=True,user_id='19568084c7264759a0c6d4e701239b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Creating volume 010ecf53-144c-46dc-a489-594823e41adf {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:53:25 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:53:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-010ecf53-144c-46dc-a489-594823e41adf 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:25 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-010ecf53-144c-46dc-a489-594823e41adf 1073741824 Jul 03 13:53:25 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:26 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-010ecf53-144c-46dc-a489-594823e41adf 1073741824" returned: 0 in 1.242s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-010ecf53-144c-46dc-a489-594823e41adf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:26 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-010ecf53-144c-46dc-a489-594823e41adf Jul 03 13:53:26 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:27 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-010ecf53-144c-46dc-a489-594823e41adf" returned: 0 in 0.816s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] <== create_volume: return (2118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:53:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b862b6b7-9812-4b3b-b640-715192c3c008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010ecf53-144c-46dc-a489-594823e41adf', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1dc71c-fded-4f79-9d42-5a1b7588f711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:27 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Volume volume-010ecf53-144c-46dc-a489-594823e41adf (010ecf53-144c-46dc-a489-594823e41adf): created successfully Jul 03 13:53:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1dc71c-fded-4f79-9d42-5a1b7588f711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Flow 'volume_create_manager' (4fc47c9b-a09f-4326-bf8b-64cf6b945052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:27 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-52a5f4c2-3c1f-42a3-a695-9cf195c88917 tempest-VolumesAdminNegativeTest-513191917 None] Created volume successfully. Jul 03 13:53:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Acquiring lock "cinder-010ecf53-144c-46dc-a489-594823e41adf-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:53:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Lock "cinder-010ecf53-144c-46dc-a489-594823e41adf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:53:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Acquiring lock "cinder-quobyte-010ecf53-144c-46dc-a489-594823e41adf" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:53:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Lock "cinder-quobyte-010ecf53-144c-46dc-a489-594823e41adf" acquired by "delete_volume" :: waited 0.028s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:53:29 devstack cinder-volume[86805]: INFO oslo.privsep.daemon [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7vsiapcg/privsep.sock'] Jul 03 13:53:29 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7vsiapcg/privsep.sock Jul 03 13:53:29 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:30 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 03 13:53:30 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 13:53:30 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 13:53:30 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 13:53:30 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 13:53:30 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 13:53:30 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 13:53:30 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 13:53:30 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 03 13:53:31 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 03 13:53:31 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 13:53:31 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 13:53:31 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 13:53:31 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 13:53:31 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 13:53:31 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 13:53:31 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 13:53:31 devstack cinder-volume[86805]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 03 13:53:32 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:32 devstack cinder-volume[86805]: INFO oslo.privsep.daemon [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Spawned new privsep daemon via rootwrap Jul 03 13:53:32 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Accepted privsep connection to /tmp/tmp7vsiapcg/privsep.sock {{(pid=86805) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 03 13:53:32 devstack cinder-volume[86805]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 03 13:53:32 devstack cinder-volume[86805]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 03 13:53:32 devstack cinder-volume[86805]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 03 13:53:32 devstack cinder-volume[86805]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87884 Jul 03 13:53:32 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d47bb7-5aa3-4920-8667-5ced920b0edb]: (2,) {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:53:32 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[72012680-bdda-439a-b006-6461fe10f5d6]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:53:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-010ecf53-144c-46dc-a489-594823e41adf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:32 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-010ecf53-144c-46dc-a489-594823e41adf Jul 03 13:53:32 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:34 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-010ecf53-144c-46dc-a489-594823e41adf" returned: 0 in 1.991s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-010ecf53-144c-46dc-a489-594823e41adf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:34 devstack sudo[87905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-010ecf53-144c-46dc-a489-594823e41adf Jul 03 13:53:34 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:35 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-010ecf53-144c-46dc-a489-594823e41adf" returned: 0 in 1.224s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Lock "cinder-quobyte-010ecf53-144c-46dc-a489-594823e41adf" released by "delete_volume" :: held 6.403s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:53:35 devstack cinder-volume[86805]: WARNING cinder.quota [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:53:35 devstack cinder-volume[86805]: WARNING cinder.quota [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:53:36 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Created reservations ['d303f1dc-d77b-48a4-a3d9-2851d9a898c5', '2d6a023b-b0c3-4dda-b8e8-5f99c558b369', 'e0fce82c-37b6-41bc-9a92-f5d282ef604d', 'f7027ecd-1492-4f8f-a13f-58056cd8361a'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:53:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:36 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:53:36 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:36 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:53:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Flow 'volume_create_manager' (1d8cb8f1-46b2-4d97-99f8-c9ebd2d3e6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf935282-9e91-46c4-9012-ff0f6151e13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf935282-9e91-46c4-9012-ff0f6151e13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-515861331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d129bb-ca39-457f-a630-577696dfbe36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d90507414844638a2c55552243132a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:37Z,use_quota=True,user_id='a0267b173a6d4fc99843572fc262788a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db2d94b-4d19-495c-8216-6029651d74b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db2d94b-4d19-495c-8216-6029651d74b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a019a24-8812-42fa-95b2-e382fc332175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a019a24-8812-42fa-95b2-e382fc332175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0d129bb-ca39-457f-a630-577696dfbe36', 'volume_name': 'volume-c0d129bb-ca39-457f-a630-577696dfbe36', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894470a8-4611-4e59-925b-f4f94f5e6329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894470a8-4611-4e59-925b-f4f94f5e6329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6a6f5b-a644-44ab-8876-c7612e5b8d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:37 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Volume c0d129bb-ca39-457f-a630-577696dfbe36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0d129bb-ca39-457f-a630-577696dfbe36', 'volume_size': 1} Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-515861331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d129bb-ca39-457f-a630-577696dfbe36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d90507414844638a2c55552243132a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:37Z,use_quota=True,user_id='a0267b173a6d4fc99843572fc262788a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Creating volume c0d129bb-ca39-457f-a630-577696dfbe36 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:53:37 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:37 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36 1073741824 Jul 03 13:53:37 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:37 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.506s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:53:37 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Deleted volume successfully. Jul 03 13:53:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e97d579c-7c89-49d4-8a2f-ab0439d5e509 tempest-VolumesAdminNegativeTest-513191917 None] Lock "cinder-010ecf53-144c-46dc-a489-594823e41adf-delete_volume" released by "delete_volume" :: held 8.331s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:53:39 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36 1073741824" returned: 0 in 1.970s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:39 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36 Jul 03 13:53:39 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:40 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36" returned: 0 in 1.172s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] <== create_volume: return (3244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:53:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.248s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6a6f5b-a644-44ab-8876-c7612e5b8d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0d129bb-ca39-457f-a630-577696dfbe36', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8f0468-9a75-4db1-ad47-f62b48aca327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:40 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Volume volume-c0d129bb-ca39-457f-a630-577696dfbe36 (c0d129bb-ca39-457f-a630-577696dfbe36): created successfully Jul 03 13:53:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8f0468-9a75-4db1-ad47-f62b48aca327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Flow 'volume_create_manager' (1d8cb8f1-46b2-4d97-99f8-c9ebd2d3e6ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:40 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b5bfaaa3-fdc7-4202-a85c-dd82fde40f8a tempest-ServerActionsTestOtherA-587473982 None] Created volume successfully. Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Flow 'volume_create_manager' (4a264687-ca33-4d0b-aa02-b55d5147334c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6cc117-b614-4bf6-86e5-b3da006d7827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6cc117-b614-4bf6-86e5-b3da006d7827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1094059042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4757d8e4-9376-4cf2-b8b7-3267ba3fd877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b943431521b54c51b4b049d83f3bdc90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:48Z,use_quota=True,user_id='e26c0ae81ca947c4b7d5517865a7c6e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62377a00-8cb8-4fb0-9716-43a2598f0e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62377a00-8cb8-4fb0-9716-43a2598f0e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2431ceb8-7014-4c59-a455-00f8e1161c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2431ceb8-7014-4c59-a455-00f8e1161c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4757d8e4-9376-4cf2-b8b7-3267ba3fd877', 'volume_name': 'volume-4757d8e4-9376-4cf2-b8b7-3267ba3fd877', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab548fa4-3122-4c88-add7-16d6cd6709d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab548fa4-3122-4c88-add7-16d6cd6709d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8bec83-4454-442d-83ed-2476d6f33f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:48 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Volume 4757d8e4-9376-4cf2-b8b7-3267ba3fd877: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4757d8e4-9376-4cf2-b8b7-3267ba3fd877', 'volume_size': 1} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1094059042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4757d8e4-9376-4cf2-b8b7-3267ba3fd877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b943431521b54c51b4b049d83f3bdc90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:48Z,use_quota=True,user_id='e26c0ae81ca947c4b7d5517865a7c6e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Creating volume 4757d8e4-9376-4cf2-b8b7-3267ba3fd877 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:53:48 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:53:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4757d8e4-9376-4cf2-b8b7-3267ba3fd877 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:48 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4757d8e4-9376-4cf2-b8b7-3267ba3fd877 1073741824 Jul 03 13:53:48 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:49 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4757d8e4-9376-4cf2-b8b7-3267ba3fd877 1073741824" returned: 0 in 1.035s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4757d8e4-9376-4cf2-b8b7-3267ba3fd877 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:49 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4757d8e4-9376-4cf2-b8b7-3267ba3fd877 Jul 03 13:53:49 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:50 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4757d8e4-9376-4cf2-b8b7-3267ba3fd877" returned: 0 in 0.960s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:53:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8bec83-4454-442d-83ed-2476d6f33f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4757d8e4-9376-4cf2-b8b7-3267ba3fd877', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84979394-38e5-460f-b865-5904b9b249ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:50 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Volume volume-4757d8e4-9376-4cf2-b8b7-3267ba3fd877 (4757d8e4-9376-4cf2-b8b7-3267ba3fd877): created successfully Jul 03 13:53:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84979394-38e5-460f-b865-5904b9b249ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Flow 'volume_create_manager' (4a264687-ca33-4d0b-aa02-b55d5147334c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:50 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-92ee0771-05c5-427e-8e83-683f99a23219 tempest-ServersNegativeTestJSON-1777452198 None] Created volume successfully. Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Flow 'volume_create_manager' (0f7571f5-cf61-43c2-ac21-4a5e66016f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b3560a-72e2-4852-9de8-9ca8dfba8b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b3560a-72e2-4852-9de8-9ca8dfba8b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1249448249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c331250b-7517-43cd-8d0b-24dca96a863b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b943431521b54c51b4b049d83f3bdc90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:56Z,use_quota=True,user_id='e26c0ae81ca947c4b7d5517865a7c6e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584fc55e-c73d-4f0b-8105-fc87160b21f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584fc55e-c73d-4f0b-8105-fc87160b21f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d499751b-736c-49fe-aeb8-93c425a055ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d499751b-736c-49fe-aeb8-93c425a055ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c331250b-7517-43cd-8d0b-24dca96a863b', 'volume_name': 'volume-c331250b-7517-43cd-8d0b-24dca96a863b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7fcc81-81ae-40c9-92f2-aab3837cb11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7fcc81-81ae-40c9-92f2-aab3837cb11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0471f4-65c0-4c90-8574-7f155c605b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:56 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Volume c331250b-7517-43cd-8d0b-24dca96a863b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c331250b-7517-43cd-8d0b-24dca96a863b', 'volume_size': 1} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1249448249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c331250b-7517-43cd-8d0b-24dca96a863b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b943431521b54c51b4b049d83f3bdc90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:56Z,use_quota=True,user_id='e26c0ae81ca947c4b7d5517865a7c6e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Creating volume c331250b-7517-43cd-8d0b-24dca96a863b {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:53:56 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:53:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c331250b-7517-43cd-8d0b-24dca96a863b 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:56 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c331250b-7517-43cd-8d0b-24dca96a863b 1073741824 Jul 03 13:53:56 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:57 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c331250b-7517-43cd-8d0b-24dca96a863b 1073741824" returned: 0 in 1.008s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c331250b-7517-43cd-8d0b-24dca96a863b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:57 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c331250b-7517-43cd-8d0b-24dca96a863b Jul 03 13:53:57 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:58 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c331250b-7517-43cd-8d0b-24dca96a863b" returned: 0 in 0.751s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:53:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0471f4-65c0-4c90-8574-7f155c605b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c331250b-7517-43cd-8d0b-24dca96a863b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d04d8e-413e-4e98-a2a5-9a17b555e2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:58 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Volume volume-c331250b-7517-43cd-8d0b-24dca96a863b (c331250b-7517-43cd-8d0b-24dca96a863b): created successfully Jul 03 13:53:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d04d8e-413e-4e98-a2a5-9a17b555e2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Flow 'volume_create_manager' (0f7571f5-cf61-43c2-ac21-4a5e66016f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:58 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-a3724c73-f40e-4bab-9cc0-319f77999ed3 tempest-ServersNegativeTestJSON-1777452198 None] Created volume successfully. Jul 03 13:53:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:53:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:58 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:53:58 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:59 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.687s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:54:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] Acquiring lock "cinder-c331250b-7517-43cd-8d0b-24dca96a863b-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] Lock "cinder-c331250b-7517-43cd-8d0b-24dca96a863b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] Acquiring lock "cinder-quobyte-c331250b-7517-43cd-8d0b-24dca96a863b" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] Lock "cinder-quobyte-c331250b-7517-43cd-8d0b-24dca96a863b" acquired by "delete_volume" :: waited 0.027s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:00 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf714ca-847c-4058-9a3a-af3e8a518b09]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c331250b-7517-43cd-8d0b-24dca96a863b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:00 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c331250b-7517-43cd-8d0b-24dca96a863b Jul 03 13:54:00 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:01 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c331250b-7517-43cd-8d0b-24dca96a863b" returned: 0 in 1.722s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c331250b-7517-43cd-8d0b-24dca96a863b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:01 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c331250b-7517-43cd-8d0b-24dca96a863b Jul 03 13:54:01 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:03 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c331250b-7517-43cd-8d0b-24dca96a863b" returned: 0 in 1.615s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] Lock "cinder-quobyte-c331250b-7517-43cd-8d0b-24dca96a863b" released by "delete_volume" :: held 3.431s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:03 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] Created reservations ['e1db1087-8b27-4710-a21c-2e32bc2afeb5', '9445320e-309a-4087-93ab-b27b645e2e97', '91053307-a3ae-49af-8e4f-20a45d391efb', '6326a9da-9a01-4538-86c7-7de8e6693929'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:54:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:03 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:54:03 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:54:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:03 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:54:03 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:04 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] Acquiring lock "cinder-4757d8e4-9376-4cf2-b8b7-3267ba3fd877-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:05 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] Lock "cinder-4757d8e4-9376-4cf2-b8b7-3267ba3fd877-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:05 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] Acquiring lock "cinder-quobyte-4757d8e4-9376-4cf2-b8b7-3267ba3fd877" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:05 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] Lock "cinder-quobyte-4757d8e4-9376-4cf2-b8b7-3267ba3fd877" acquired by "delete_volume" :: waited 0.060s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:05 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae87ddb1-4bce-4cd5-9d82-5346d5668469]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4757d8e4-9376-4cf2-b8b7-3267ba3fd877 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:05 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4757d8e4-9376-4cf2-b8b7-3267ba3fd877 Jul 03 13:54:05 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:05 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.662s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:05 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:54:05 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] Deleted volume successfully. Jul 03 13:54:05 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-93feb406-6f59-44a9-8f83-980b7d6f7e9e tempest-ServersNegativeTestJSON-1777452198 None] Lock "cinder-c331250b-7517-43cd-8d0b-24dca96a863b-delete_volume" released by "delete_volume" :: held 5.602s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:06 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4757d8e4-9376-4cf2-b8b7-3267ba3fd877" returned: 0 in 1.446s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4757d8e4-9376-4cf2-b8b7-3267ba3fd877 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:06 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4757d8e4-9376-4cf2-b8b7-3267ba3fd877 Jul 03 13:54:06 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4757d8e4-9376-4cf2-b8b7-3267ba3fd877" returned: 0 in 1.254s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:07 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] Lock "cinder-quobyte-4757d8e4-9376-4cf2-b8b7-3267ba3fd877" released by "delete_volume" :: held 2.850s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:08 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] Created reservations ['46f1443b-eaf2-4acf-a882-069d678e84d6', 'c5052005-5895-4256-8834-65c0c54ba7a6', '8a225b02-2156-41ee-a0d7-c785c0db0c73', 'e525c1de-2c22-4d4c-ba41-b63f9da01677'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:54:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:54:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:54:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:08 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:54:08 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:10 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.738s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:10 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:54:10 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] Deleted volume successfully. Jul 03 13:54:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-072fcb5c-14a6-43cc-b53b-185757f90db8 tempest-ServersNegativeTestJSON-1777452198 None] Lock "cinder-4757d8e4-9376-4cf2-b8b7-3267ba3fd877-delete_volume" released by "delete_volume" :: held 5.197s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:18 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=31,cinder:UPDATE=42,cinder:INSERT=6,cinder:DELETE=4 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:54:20 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=16,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=10 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:54:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-03411a43-6698-41ec-877b-120ef618f080 tempest-GroupSnapshotsTest-1566434193 None] Group tempest-GroupSnapshotsTest-Group-1187949876: creating Jul 03 13:54:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-03411a43-6698-41ec-877b-120ef618f080 tempest-GroupSnapshotsTest-1566434193 None] Group tempest-GroupSnapshotsTest-Group-1187949876: created successfully Jul 03 13:54:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-03411a43-6698-41ec-877b-120ef618f080 tempest-GroupSnapshotsTest-1566434193 None] Create group completed successfully. Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Flow 'volume_create_manager' (1e24aed3-8c35-4ecc-b926-70c0f32f060f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961be1b4-8fe5-43d4-ba58-8071edc3fa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961be1b4-8fe5-43d4-ba58-8071edc3fa36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2050687060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de41faf3-7301-4074-b2e0-afc4bdb97d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031eab72ce044daeb7e70c150f2d9909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:54:30Z,use_quota=True,user_id='deeec049ef2d418c8a650453432578d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e633cc6-7f69-4e3c-b8da-4a904b0e6aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e633cc6-7f69-4e3c-b8da-4a904b0e6aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e578b99-16a7-43dc-95a9-549b11dace11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e578b99-16a7-43dc-95a9-549b11dace11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de41faf3-7301-4074-b2e0-afc4bdb97d1a', 'volume_name': 'volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b7ff1e-d3b8-422b-8c11-12500c754e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b7ff1e-d3b8-422b-8c11-12500c754e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223fe907-a0ec-4153-899d-9aa4987c665a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:29 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Volume de41faf3-7301-4074-b2e0-afc4bdb97d1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a', 'volume_size': 1} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2050687060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de41faf3-7301-4074-b2e0-afc4bdb97d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031eab72ce044daeb7e70c150f2d9909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:54:30Z,use_quota=True,user_id='deeec049ef2d418c8a650453432578d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Creating volume de41faf3-7301-4074-b2e0-afc4bdb97d1a {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:54:29 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:54:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:29 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a 1073741824 Jul 03 13:54:29 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:30 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:54:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Flow 'volume_create_manager' (08874008-258d-46c8-9b97-8113bc7b43e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:54:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae417b0-72e6-479a-9912-821fc5134062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae417b0-72e6-479a-9912-821fc5134062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1462714051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55272112-a516-4f5d-aa7c-ad228ebd8c93,host='devstack@QuobyteHD#QuobyteHD',id=f374de0c-cd3e-4cad-80b9-80509a2c3066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15266b9ccd440c3b581601e084e9a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:54:31Z,use_quota=True,user_id='6c750c37ca454a47a32f5b46e528dd01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5989b702-a700-483a-8bc1-79dbea69ffde),volume_type_id=5989b702-a700-483a-8bc1-79dbea69ffde)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da73a7e6-325b-45de-9aa8-783f820502aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da73a7e6-325b-45de-9aa8-783f820502aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d939fcb-fbdc-4383-8b81-38ab5780a3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d939fcb-fbdc-4383-8b81-38ab5780a3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f374de0c-cd3e-4cad-80b9-80509a2c3066', 'volume_name': 'volume-f374de0c-cd3e-4cad-80b9-80509a2c3066', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c804c3-4edb-4f35-9520-04cb2ecdedf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c804c3-4edb-4f35-9520-04cb2ecdedf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0240ebf1-b42c-43e4-b7e9-9fae53d63480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:30 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Volume f374de0c-cd3e-4cad-80b9-80509a2c3066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f374de0c-cd3e-4cad-80b9-80509a2c3066', 'volume_size': 1} Jul 03 13:54:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:30 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a 1073741824" returned: 0 in 1.161s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:31 devstack sudo[88518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a Jul 03 13:54:31 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:31 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a" returned: 0 in 0.659s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.778s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=55272112-a516-4f5d-aa7c-ad228ebd8c93,created_at=2026-07-03T11:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1462714051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55272112-a516-4f5d-aa7c-ad228ebd8c93,host='devstack@QuobyteHD#QuobyteHD',id=f374de0c-cd3e-4cad-80b9-80509a2c3066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15266b9ccd440c3b581601e084e9a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:54:31Z,use_quota=True,user_id='6c750c37ca454a47a32f5b46e528dd01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5989b702-a700-483a-8bc1-79dbea69ffde),volume_type_id=5989b702-a700-483a-8bc1-79dbea69ffde)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Creating volume f374de0c-cd3e-4cad-80b9-80509a2c3066 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:54:31 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:31 devstack sudo[88525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 1073741824 Jul 03 13:54:31 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223fe907-a0ec-4153-899d-9aa4987c665a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c138b62-5286-4b27-87ea-aea092e6108c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:31 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Volume volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a (de41faf3-7301-4074-b2e0-afc4bdb97d1a): created successfully Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c138b62-5286-4b27-87ea-aea092e6108c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Flow 'volume_create_manager' (1e24aed3-8c35-4ecc-b926-70c0f32f060f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:54:31 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-7461bce2-aa41-4561-8302-ba175d206e07 tempest-AttachVolumeTestJSON-798433461 None] Created volume successfully. Jul 03 13:54:32 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 1073741824" returned: 0 in 0.959s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:32 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 Jul 03 13:54:32 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:33 devstack cinder-volume[86805]: WARNING py.warnings [req-59206a28-09b2-4059-8980-b944ebb608d4 req-099d34fb-c0e7-4fe4-80a5-8708a00ec0f9 tempest-ServerActionsTestOtherA-587473982 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 03 13:54:33 devstack cinder-volume[86805]: .first() Jul 03 13:54:33 devstack cinder-volume[86805]: Jul 03 13:54:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-59206a28-09b2-4059-8980-b944ebb608d4 req-099d34fb-c0e7-4fe4-80a5-8708a00ec0f9 tempest-ServerActionsTestOtherA-587473982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:33 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066" returned: 0 in 0.735s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:54:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-59206a28-09b2-4059-8980-b944ebb608d4 req-099d34fb-c0e7-4fe4-80a5-8708a00ec0f9 tempest-ServerActionsTestOtherA-587473982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.195s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:33 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0240ebf1-b42c-43e4-b7e9-9fae53d63480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f374de0c-cd3e-4cad-80b9-80509a2c3066', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:33 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ef9b1c-a538-4f17-bde0-9225272d44fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:33 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1691f7-bfd6-4e05-b6ae-f35641ae8fdc]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-59206a28-09b2-4059-8980-b944ebb608d4 req-099d34fb-c0e7-4fe4-80a5-8708a00ec0f9 tempest-ServerActionsTestOtherA-587473982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:33 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Volume volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 (f374de0c-cd3e-4cad-80b9-80509a2c3066): created successfully Jul 03 13:54:33 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ef9b1c-a538-4f17-bde0-9225272d44fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:33 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Flow 'volume_create_manager' (08874008-258d-46c8-9b97-8113bc7b43e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:54:33 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-733153f4-6cdb-4689-9700-872026d55bd3 tempest-GroupSnapshotsTest-1566434193 None] Created volume successfully. Jul 03 13:54:33 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36 Jul 03 13:54:33 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:34 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-59206a28-09b2-4059-8980-b944ebb608d4 req-099d34fb-c0e7-4fe4-80a5-8708a00ec0f9 tempest-ServerActionsTestOtherA-587473982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36" returned: 0 in 0.749s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-59206a28-09b2-4059-8980-b944ebb608d4 req-099d34fb-c0e7-4fe4-80a5-8708a00ec0f9 tempest-ServerActionsTestOtherA-587473982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.776s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-59206a28-09b2-4059-8980-b944ebb608d4 req-099d34fb-c0e7-4fe4-80a5-8708a00ec0f9 tempest-ServerActionsTestOtherA-587473982 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-c0d129bb-ca39-457f-a630-577696dfbe36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08f01f18-07c7-41b2-8082-946c127cc996', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:54:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-59206a28-09b2-4059-8980-b944ebb608d4 req-099d34fb-c0e7-4fe4-80a5-8708a00ec0f9 tempest-ServerActionsTestOtherA-587473982 None] attachment_update completed successfully. Jul 03 13:54:35 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] GroupSnapshot 4f3128e6-28fc-4125-9870-00eae820c9fd: creating. Jul 03 13:54:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] Group snapshot 4f3128e6-28fc-4125-9870-00eae820c9fd: creating. {{(pid=86805) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 13:54:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:35 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] Creating offline snapshot e709693f-7a8a-45d4-b1a2-bb809793e4f3 of volume f374de0c-cd3e-4cad-80b9-80509a2c3066 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:54:35 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c96345-4adc-4f26-aa26-d6f3c0d1a258]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:35 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 Jul 03 13:54:35 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:36 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066" returned: 0 in 0.996s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:36 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3 1G Jul 03 13:54:36 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-de68433e-cc66-4985-b7cc-02df2c92c1e1 req-8fbebd3c-1a7e-4b6b-a9c6-c1bc79ecd35a tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:37 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3 1G" returned: 0 in 0.972s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:37 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3 Jul 03 13:54:37 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:38 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:54:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Flow 'volume_create_manager' (43ee7848-3099-4113-b15c-06fe4448772e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:54:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5338d3-f8c4-4485-9afe-4168adcd82da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5338d3-f8c4-4485-9afe-4168adcd82da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1518849300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd871414c19d4d73a47b4dc086ffbe34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:54:38Z,use_quota=True,user_id='551ead629fd14364a1ad2dabc7fa2064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c7be50-45c4-43ff-baa3-91d3406437e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c7be50-45c4-43ff-baa3-91d3406437e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14cbd0cf-1ffe-4980-9ee6-0d244d4dcbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14cbd0cf-1ffe-4980-9ee6-0d244d4dcbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7', 'volume_name': 'volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520ce067-b499-41e1-bfa6-78cc9add4eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520ce067-b499-41e1-bfa6-78cc9add4eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc79c3a-4bc6-4516-993b-278a34e2b66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:38 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Volume 4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7', 'volume_size': 1} Jul 03 13:54:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:38 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3" returned: 0 in 0.823s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:38 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:54:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:38 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3 Jul 03 13:54:38 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:38 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3" returned: 0 in 0.714s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:39 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.info Jul 03 13:54:39 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:39 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.info" returned: 0 in 0.723s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:39 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:54:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:39 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.info Jul 03 13:54:39 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:40 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.info" returned: 0 in 0.934s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.275s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-de68433e-cc66-4985-b7cc-02df2c92c1e1 req-8fbebd3c-1a7e-4b6b-a9c6-c1bc79ecd35a tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.064s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:40 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07de565-07c1-4e59-b357-bda9af4fe6de]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-de68433e-cc66-4985-b7cc-02df2c92c1e1 req-8fbebd3c-1a7e-4b6b-a9c6-c1bc79ecd35a tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:40 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-59fac3a7-43bc-465c-9a8c-7647a51e6232 tempest-GroupSnapshotsTest-1566434193 None] group_snapshot 4f3128e6-28fc-4125-9870-00eae820c9fd: created successfully Jul 03 13:54:40 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a Jul 03 13:54:40 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:41 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-de68433e-cc66-4985-b7cc-02df2c92c1e1 req-8fbebd3c-1a7e-4b6b-a9c6-c1bc79ecd35a tempest-AttachVolumeTestJSON-798433461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a" returned: 0 in 0.848s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-de68433e-cc66-4985-b7cc-02df2c92c1e1 req-8fbebd3c-1a7e-4b6b-a9c6-c1bc79ecd35a tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.892s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.420s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1518849300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd871414c19d4d73a47b4dc086ffbe34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:54:38Z,use_quota=True,user_id='551ead629fd14364a1ad2dabc7fa2064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:54:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Creating volume 4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:54:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:54:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:54:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:54:41 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:54:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:41 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7 1073741824 Jul 03 13:54:41 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-de68433e-cc66-4985-b7cc-02df2c92c1e1 req-8fbebd3c-1a7e-4b6b-a9c6-c1bc79ecd35a tempest-AttachVolumeTestJSON-798433461 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e91d81e1-db85-4a3e-b4c9-7fe15ac1394e', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:54:41 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-de68433e-cc66-4985-b7cc-02df2c92c1e1 req-8fbebd3c-1a7e-4b6b-a9c6-c1bc79ecd35a tempest-AttachVolumeTestJSON-798433461 None] attachment_update completed successfully. Jul 03 13:54:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:43 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-0ca7d8db-2549-49cf-9bf2-990ce513d608 req-6f5e5d4b-0dbc-4cd3-aa87-940d172cc68e tempest-ServerActionsTestOtherA-587473982 None] Terminate volume connection completed successfully. Jul 03 13:54:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-0ca7d8db-2549-49cf-9bf2-990ce513d608 req-6f5e5d4b-0dbc-4cd3-aa87-940d172cc68e tempest-ServerActionsTestOtherA-587473982 None] Deleting attachment 08f01f18-07c7-41b2-8082-946c127cc996. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:54:43 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7 1073741824" returned: 0 in 1.649s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:43 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7 Jul 03 13:54:43 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:43 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7" returned: 0 in 0.685s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] <== create_volume: return (2376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:54:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.380s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.956s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "cinder-quobyte-e709693f-7a8a-45d4-b1a2-bb809793e4f3-fb7f8da0-6112-42fd-95bb-319fc22ada89" by "_create_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc79c3a-4bc6-4516-993b-278a34e2b66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfed9d5-b79c-4a14-88f3-87950527d053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-e709693f-7a8a-45d4-b1a2-bb809793e4f3-fb7f8da0-6112-42fd-95bb-319fc22ada89" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Creating volume fb7f8da0-6112-42fd-95bb-319fc22ada89 from snapshot e709693f-7a8a-45d4-b1a2-bb809793e4f3 {{(pid=86805) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "cinder-quobyte-fb7f8da0-6112-42fd-95bb-319fc22ada89" by "_copy_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:44 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Volume volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7 (4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7): created successfully Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfed9d5-b79c-4a14-88f3-87950527d053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Flow 'volume_create_manager' (43ee7848-3099-4113-b15c-06fe4448772e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-fb7f8da0-6112-42fd-95bb-319fc22ada89" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] snapshot: e709693f-7a8a-45d4-b1a2-bb809793e4f3, volume: fb7f8da0-6112-42fd-95bb-319fc22ada89, {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 13:54:44 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-2945bbfd-6943-4952-a873-0f402e226f36 tempest-DeleteServersTestJSON-123505730 None] Created volume successfully. Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb894c25-f836-4479-99d4-567bdfd0c3f5]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:44 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3 Jul 03 13:54:44 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:45 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3" returned: 0 in 0.936s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f374de0c-cd3e-4cad-80b9-80509a2c3066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:54:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] will copy from snapshot at /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 13:54:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Creating direct copy from snapshot {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 13:54:45 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[085f7d21-123d-4cd4-828c-79017b2699e1]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:45 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 Jul 03 13:54:45 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-0ca7d8db-2549-49cf-9bf2-990ce513d608 req-2284003d-3b72-4109-89c4-8ae275372c33 tempest-ServerActionsTestOtherA-587473982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:46 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066" returned: 0 in 0.898s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:46 devstack cinder-volume[86805]: DEBUG cinder.utils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Path /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fb7f8da0-6112-42fd-95bb-319fc22ada89 not found in is_blk_device check {{(pid=86805) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 13:54:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fb7f8da0-6112-42fd-95bb-319fc22ada89 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:46 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fb7f8da0-6112-42fd-95bb-319fc22ada89 Jul 03 13:54:46 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-f5a3fa9f-73d2-44b5-bdcd-f178a4d7d49e req-1b300ab6-35ad-4763-9271-30e91f380dc7 tempest-DeleteServersTestJSON-123505730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:52 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fb7f8da0-6112-42fd-95bb-319fc22ada89" returned: 0 in 6.662s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:52 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de7a9f8-0f40-477d-b28d-3dd382fdeb09]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:52 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 Jul 03 13:54:52 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:53 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066" returned: 0 in 1.010s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:53 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Image conversion details: src /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fb7f8da0-6112-42fd-95bb-319fc22ada89 {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:54:53 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Converted 1024.00 MB image at 153.68 MB/s Jul 03 13:54:53 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fb7f8da0-6112-42fd-95bb-319fc22ada89 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:54:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fb7f8da0-6112-42fd-95bb-319fc22ada89 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:53 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fb7f8da0-6112-42fd-95bb-319fc22ada89 Jul 03 13:54:53 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:54 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fb7f8da0-6112-42fd-95bb-319fc22ada89" returned: 0 in 0.660s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:54 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-fb7f8da0-6112-42fd-95bb-319fc22ada89" released by "_copy_volume_from_snapshot" :: held 10.341s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:54 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-e709693f-7a8a-45d4-b1a2-bb809793e4f3-fb7f8da0-6112-42fd-95bb-319fc22ada89" released by "_create_volume_from_snapshot" :: held 10.385s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.430s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-0ca7d8db-2549-49cf-9bf2-990ce513d608 req-2284003d-3b72-4109-89c4-8ae275372c33 tempest-ServerActionsTestOtherA-587473982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.543s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:54 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda87f8b-84e4-45a9-a9b0-8c953e384a52]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-0ca7d8db-2549-49cf-9bf2-990ce513d608 req-2284003d-3b72-4109-89c4-8ae275372c33 tempest-ServerActionsTestOtherA-587473982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:54 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36 Jul 03 13:54:54 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:54 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b39169d3-5c92-4cc2-a1d2-520c18091508 tempest-GroupSnapshotsTest-1566434193 None] Create group from source-snapshot-4f3128e6-28fc-4125-9870-00eae820c9fd completed successfully. Jul 03 13:54:55 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-0ca7d8db-2549-49cf-9bf2-990ce513d608 req-2284003d-3b72-4109-89c4-8ae275372c33 tempest-ServerActionsTestOtherA-587473982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36" returned: 0 in 0.859s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-0ca7d8db-2549-49cf-9bf2-990ce513d608 req-2284003d-3b72-4109-89c4-8ae275372c33 tempest-ServerActionsTestOtherA-587473982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.934s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-f5a3fa9f-73d2-44b5-bdcd-f178a4d7d49e req-1b300ab6-35ad-4763-9271-30e91f380dc7 tempest-DeleteServersTestJSON-123505730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.359s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:55 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[787806bd-bba8-4920-a8d9-6bb9b2e2f990]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-f5a3fa9f-73d2-44b5-bdcd-f178a4d7d49e req-1b300ab6-35ad-4763-9271-30e91f380dc7 tempest-DeleteServersTestJSON-123505730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-0ca7d8db-2549-49cf-9bf2-990ce513d608 req-2284003d-3b72-4109-89c4-8ae275372c33 tempest-ServerActionsTestOtherA-587473982 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-c0d129bb-ca39-457f-a630-577696dfbe36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76ebdfac-55e6-4508-82ce-c480a3b90adf', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:54:55 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-0ca7d8db-2549-49cf-9bf2-990ce513d608 req-2284003d-3b72-4109-89c4-8ae275372c33 tempest-ServerActionsTestOtherA-587473982 None] attachment_update completed successfully. Jul 03 13:54:55 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7 Jul 03 13:54:55 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:56 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-f5a3fa9f-73d2-44b5-bdcd-f178a4d7d49e req-1b300ab6-35ad-4763-9271-30e91f380dc7 tempest-DeleteServersTestJSON-123505730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7" returned: 0 in 1.051s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-f5a3fa9f-73d2-44b5-bdcd-f178a4d7d49e req-1b300ab6-35ad-4763-9271-30e91f380dc7 tempest-DeleteServersTestJSON-123505730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.072s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-f5a3fa9f-73d2-44b5-bdcd-f178a4d7d49e req-1b300ab6-35ad-4763-9271-30e91f380dc7 tempest-DeleteServersTestJSON-123505730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1831a0b3-0f45-4d19-8d1b-8edb64c92ce8', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:54:56 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-f5a3fa9f-73d2-44b5-bdcd-f178a4d7d49e req-1b300ab6-35ad-4763-9271-30e91f380dc7 tempest-DeleteServersTestJSON-123505730 None] attachment_update completed successfully. Jul 03 13:54:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "cinder-quobyte-fb7f8da0-6112-42fd-95bb-319fc22ada89" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-fb7f8da0-6112-42fd-95bb-319fc22ada89" acquired by "delete_volume" :: waited 0.049s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:57 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf131dd-92ab-4057-90c3-b6a30a772dfb]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fb7f8da0-6112-42fd-95bb-319fc22ada89 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:57 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fb7f8da0-6112-42fd-95bb-319fc22ada89 Jul 03 13:54:57 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:57 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fb7f8da0-6112-42fd-95bb-319fc22ada89" returned: 0 in 0.920s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fb7f8da0-6112-42fd-95bb-319fc22ada89 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:57 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fb7f8da0-6112-42fd-95bb-319fc22ada89 Jul 03 13:54:57 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:54:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:54:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:54:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:58 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:54:58 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:58 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fb7f8da0-6112-42fd-95bb-319fc22ada89" returned: 0 in 0.823s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:58 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-fb7f8da0-6112-42fd-95bb-319fc22ada89" released by "delete_volume" :: held 1.816s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:58 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] Created reservations ['66b3ae0c-4ab7-44ad-ba49-294207eb5272'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:54:58 devstack cinder-volume[86805]: WARNING cinder.quota [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1663985813 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1663985813, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:54:58 devstack cinder-volume[86805]: WARNING cinder.quota [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1663985813 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1663985813, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:54:58 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] Created reservations ['52f82e1b-a8a1-4143-8259-7f9942138513', 'aeb5312f-8ab6-46d8-b9c0-1a97c5fab352', '750e4f11-6c4b-4464-9477-f5efa0682472', '337b7cec-3b49-4dea-9718-783f0fe36747'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:59 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:54:59 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:59 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.874s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:54:59 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] group_snapshot 4f3128e6-28fc-4125-9870-00eae820c9fd: deleting Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] group_snapshot 4f3128e6-28fc-4125-9870-00eae820c9fd: deleting {{(pid=86805) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "cinder-quobyte-f374de0c-cd3e-4cad-80b9-80509a2c3066" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-f374de0c-cd3e-4cad-80b9-80509a2c3066" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "cinder-quobyte-e709693f-7a8a-45d4-b1a2-bb809793e4f3" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-e709693f-7a8a-45d4-b1a2-bb809793e4f3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] Deleting offline snapshot e709693f-7a8a-45d4-b1a2-bb809793e4f3 of volume f374de0c-cd3e-4cad-80b9-80509a2c3066 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] snapshot_file for this snap is: volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1599d4df-310f-47b9-a3db-995b1145b286]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:59 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3 Jul 03 13:54:59 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:59 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.878s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:54:59 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e083ab5f-f0a9-4847-aa0b-7dda46fc370c tempest-GroupSnapshotsTest-1566434193 None] Delete group completed successfully. Jul 03 13:55:00 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3" returned: 0 in 1.329s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f374de0c-cd3e-4cad-80b9-80509a2c3066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:55:01 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[989d36fc-5c67-456d-bcc3-868c44a60953]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:01 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 Jul 03 13:55:01 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:02 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066" returned: 0 in 1.827s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:02 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3 Jul 03 13:55:02 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:04 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3" returned: 0 in 1.809s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:04 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3 Jul 03 13:55:04 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:06 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066.e709693f-7a8a-45d4-b1a2-bb809793e4f3" returned: 0 in 1.425s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-e709693f-7a8a-45d4-b1a2-bb809793e4f3" released by "_delete_snapshot" :: held 6.605s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-f374de0c-cd3e-4cad-80b9-80509a2c3066" released by "delete_snapshot" :: held 6.637s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:06 devstack cinder-volume[86805]: WARNING cinder.quota [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1663985813 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1663985813, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:55:06 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] Created reservations ['46b5fdb7-858e-4188-906c-2caf606d076f', 'c1a464d4-167b-4366-88d1-3fca35fe8c1e', 'ebb804ca-f5d6-4099-b033-eb2dc12bb674', '6d17a7f5-f176-4050-849a-53105cae6376'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:55:06 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-964a6111-9f71-47e0-805c-ef2b25f0dd9f tempest-GroupSnapshotsTest-1566434193 None] group_snapshot 4f3128e6-28fc-4125-9870-00eae820c9fd: deleted successfully Jul 03 13:55:07 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-4eefc73e-1624-463e-9591-2d6ea3ff7001 req-e4aa7a1b-f439-4cba-b30a-b174b5f37ecb tempest-DeleteServersTestJSON-123505730 None] Terminate volume connection completed successfully. Jul 03 13:55:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-4eefc73e-1624-463e-9591-2d6ea3ff7001 req-e4aa7a1b-f439-4cba-b30a-b174b5f37ecb tempest-DeleteServersTestJSON-123505730 None] Deleting attachment 1831a0b3-0f45-4d19-8d1b-8edb64c92ce8. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:55:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "cinder-quobyte-f374de0c-cd3e-4cad-80b9-80509a2c3066" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-f374de0c-cd3e-4cad-80b9-80509a2c3066" acquired by "delete_volume" :: waited 0.026s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:07 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40193ce-2b62-4a13-9ee3-83f1ac501100]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:08 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 Jul 03 13:55:08 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:08 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066" returned: 0 in 0.953s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:08 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066 Jul 03 13:55:08 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:09 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f374de0c-cd3e-4cad-80b9-80509a2c3066" returned: 0 in 0.862s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-f374de0c-cd3e-4cad-80b9-80509a2c3066" released by "delete_volume" :: held 1.905s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:09 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] Created reservations ['bf22596d-a6c5-43b4-a28d-655876db7b07'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:55:09 devstack cinder-volume[86805]: WARNING cinder.db.sqlalchemy.api [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1663985813'] Jul 03 13:55:09 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] Created reservations ['c27b47f0-3594-471a-bceb-63715787a219', '736dc372-bbf6-4845-9f74-6a32abff1a08', '2851a7bd-d8c9-4599-aad3-e4ba44e63666', 'e68c881d-4dfb-4f35-b8cb-0c2273202bdb'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:55:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:55:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:55:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:10 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:55:10 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:10 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.946s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:10 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:55:11 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-92d7e7cd-5f9d-4447-8c09-ca466bb683aa tempest-GroupSnapshotsTest-1566434193 None] Delete group completed successfully. Jul 03 13:55:11 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-1d4d14ed-e7b8-48a0-8622-b35b4fa8752c tempest-GroupSnapshotsTest-1566434193 None] Group tempest-GroupSnapshotsTest-Group-598701402: creating Jul 03 13:55:11 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-1d4d14ed-e7b8-48a0-8622-b35b4fa8752c tempest-GroupSnapshotsTest-1566434193 None] Group tempest-GroupSnapshotsTest-Group-598701402: created successfully Jul 03 13:55:11 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-1d4d14ed-e7b8-48a0-8622-b35b4fa8752c tempest-GroupSnapshotsTest-1566434193 None] Create group completed successfully. Jul 03 13:55:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] Acquiring lock "cinder-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] Lock "cinder-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] Acquiring lock "cinder-quobyte-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] Lock "cinder-quobyte-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7" acquired by "delete_volume" :: waited 0.013s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:12 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca010f9-70d5-45d5-aa93-e72063b38664]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:12 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7 Jul 03 13:55:12 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Flow 'volume_create_manager' (003335b7-b424-44f6-a8d5-79a307fac347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5604815c-ba26-4d4c-9cc9-daa8d6b6ed7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5604815c-ba26-4d4c-9cc9-daa8d6b6ed7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-740957899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d3b3512-f52b-4c04-980b-505a2bdfa7cd,host='devstack@QuobyteHD#QuobyteHD',id=ca8438b9-9474-4860-871e-3b453667f5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15266b9ccd440c3b581601e084e9a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:55:13Z,use_quota=True,user_id='6c750c37ca454a47a32f5b46e528dd01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37ae5fbb-7531-4caa-8bfe-55454fb40fff),volume_type_id=37ae5fbb-7531-4caa-8bfe-55454fb40fff)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936bcc8e-c1b1-404b-bf1f-748d1bdf44fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936bcc8e-c1b1-404b-bf1f-748d1bdf44fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:13 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f3f4cd-89a1-4d82-96e5-140f4e9946ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f3f4cd-89a1-4d82-96e5-140f4e9946ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca8438b9-9474-4860-871e-3b453667f5e0', 'volume_name': 'volume-ca8438b9-9474-4860-871e-3b453667f5e0', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048a44c2-277b-42f4-824f-dd1c87ecc7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048a44c2-277b-42f4-824f-dd1c87ecc7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a784d0b-1e41-45bd-8a14-f912f5e55997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:13 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Volume ca8438b9-9474-4860-871e-3b453667f5e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca8438b9-9474-4860-871e-3b453667f5e0', 'volume_size': 1} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d3b3512-f52b-4c04-980b-505a2bdfa7cd,created_at=2026-07-03T11:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-740957899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d3b3512-f52b-4c04-980b-505a2bdfa7cd,host='devstack@QuobyteHD#QuobyteHD',id=ca8438b9-9474-4860-871e-3b453667f5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15266b9ccd440c3b581601e084e9a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:55:13Z,use_quota=True,user_id='6c750c37ca454a47a32f5b46e528dd01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37ae5fbb-7531-4caa-8bfe-55454fb40fff),volume_type_id=37ae5fbb-7531-4caa-8bfe-55454fb40fff)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Creating volume ca8438b9-9474-4860-871e-3b453667f5e0 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:55:13 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7" returned: 0 in 1.139s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:13 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0 1073741824 Jul 03 13:55:13 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:13 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7 Jul 03 13:55:13 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:14 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0 1073741824" returned: 0 in 1.112s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:14 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7" returned: 0 in 1.122s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:14 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] Lock "cinder-quobyte-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7" released by "delete_volume" :: held 2.325s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:14 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0 Jul 03 13:55:14 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:14 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] Created reservations ['b29249d1-738d-4ddb-8392-d20f59ffa3ff', '091c3b9e-94a7-4110-92f0-908fb9f8a25d', 'ccd8b37e-0e82-4d26-9e6a-68bff866690a', '07b9c7ad-fbc8-49be-a46c-bbbfb3ececfa'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:55:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:55:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:55:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:14 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:55:14 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:15 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0" returned: 0 in 0.932s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] <== create_volume: return (2166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:55:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.169s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a784d0b-1e41-45bd-8a14-f912f5e55997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca8438b9-9474-4860-871e-3b453667f5e0', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8826c681-c3e6-4a05-8200-2748c8a66706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:15 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Volume volume-ca8438b9-9474-4860-871e-3b453667f5e0 (ca8438b9-9474-4860-871e-3b453667f5e0): created successfully Jul 03 13:55:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8826c681-c3e6-4a05-8200-2748c8a66706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Flow 'volume_create_manager' (003335b7-b424-44f6-a8d5-79a307fac347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:55:15 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-09d89cb2-7ca2-4a4f-a60e-2e43b4752db0 tempest-GroupSnapshotsTest-1566434193 None] Created volume successfully. Jul 03 13:55:15 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.127s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:15 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:55:15 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] Deleted volume successfully. Jul 03 13:55:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f0e71719-c068-40ee-8674-86aff9c19871 tempest-DeleteServersTestJSON-123505730 None] Lock "cinder-4ed0e1e4-7807-47aa-a0bd-eaf66fc85ff7-delete_volume" released by "delete_volume" :: held 3.876s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:16 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:55:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Flow 'volume_create_manager' (b3684946-2cdf-4c10-b8b2-89885b094ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:55:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a7a9e0-4845-4a27-85cf-9d7383e16483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a7a9e0-4845-4a27-85cf-9d7383e16483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1438751648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d3b3512-f52b-4c04-980b-505a2bdfa7cd,host='devstack@QuobyteHD#QuobyteHD',id=5a6e6c5e-ec68-436b-997f-6adfdde00949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15266b9ccd440c3b581601e084e9a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:55:17Z,use_quota=True,user_id='6c750c37ca454a47a32f5b46e528dd01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37ae5fbb-7531-4caa-8bfe-55454fb40fff),volume_type_id=37ae5fbb-7531-4caa-8bfe-55454fb40fff)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8973fe6-d50f-430c-9b78-b0e84e966cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8973fe6-d50f-430c-9b78-b0e84e966cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569d959b-475f-4d9c-a16b-df9376fff964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569d959b-475f-4d9c-a16b-df9376fff964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a6e6c5e-ec68-436b-997f-6adfdde00949', 'volume_name': 'volume-5a6e6c5e-ec68-436b-997f-6adfdde00949', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05daba8-b407-46dc-9da9-b6f98bebe769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05daba8-b407-46dc-9da9-b6f98bebe769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2499207d-c553-4db0-a12a-a28a7857a486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:17 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Volume 5a6e6c5e-ec68-436b-997f-6adfdde00949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a6e6c5e-ec68-436b-997f-6adfdde00949', 'volume_size': 1} Jul 03 13:55:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d3b3512-f52b-4c04-980b-505a2bdfa7cd,created_at=2026-07-03T11:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1438751648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d3b3512-f52b-4c04-980b-505a2bdfa7cd,host='devstack@QuobyteHD#QuobyteHD',id=5a6e6c5e-ec68-436b-997f-6adfdde00949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15266b9ccd440c3b581601e084e9a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:55:17Z,use_quota=True,user_id='6c750c37ca454a47a32f5b46e528dd01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37ae5fbb-7531-4caa-8bfe-55454fb40fff),volume_type_id=37ae5fbb-7531-4caa-8bfe-55454fb40fff)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:55:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Creating volume 5a6e6c5e-ec68-436b-997f-6adfdde00949 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:55:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:55:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:55:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:55:17 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:55:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:17 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949 1073741824 Jul 03 13:55:17 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:17 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949 1073741824" returned: 0 in 0.970s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:18 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949 Jul 03 13:55:18 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:18 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949" returned: 0 in 0.770s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:55:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2499207d-c553-4db0-a12a-a28a7857a486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a6e6c5e-ec68-436b-997f-6adfdde00949', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb476d1-1ca4-43e5-92d4-2479899ce4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:18 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Volume volume-5a6e6c5e-ec68-436b-997f-6adfdde00949 (5a6e6c5e-ec68-436b-997f-6adfdde00949): created successfully Jul 03 13:55:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb476d1-1ca4-43e5-92d4-2479899ce4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Flow 'volume_create_manager' (b3684946-2cdf-4c10-b8b2-89885b094ead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:55:19 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f657ebb6-2a96-4ae8-929f-fa7dda81e546 tempest-GroupSnapshotsTest-1566434193 None] Created volume successfully. Jul 03 13:55:19 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-6413765d-9ac0-46e2-8618-daf43d584687 tempest-GroupSnapshotsTest-1566434193 None] Update group completed successfully. Jul 03 13:55:20 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=80,cinder:UPDATE=72,cinder:DELETE=3,cinder:INSERT=16 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:55:20 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-34669e9b-fe25-49db-ae8e-bcb4575bfff7 tempest-GroupSnapshotsTest-1566434193 None] Update group completed successfully. Jul 03 13:55:21 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b28740e5-66cf-4e8a-827b-9515ab35f997 tempest-GroupSnapshotsTest-1566434193 None] Update group completed successfully. Jul 03 13:55:23 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-18db36d4-6db1-41db-beec-2cdaf461ae09 tempest-GroupSnapshotsTest-1566434193 None] Update group completed successfully. Jul 03 13:55:24 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] GroupSnapshot a7cfa1b0-cdc6-4d59-8da3-af1299226dea: creating. Jul 03 13:55:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Group snapshot a7cfa1b0-cdc6-4d59-8da3-af1299226dea: creating. {{(pid=86805) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 13:55:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Creating offline snapshot 8e29580b-b300-42f3-9d4f-54a602b32bae of volume ca8438b9-9474-4860-871e-3b453667f5e0 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:55:24 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[db96b06a-9895-4484-9886-46a65f566527]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:24 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0 Jul 03 13:55:24 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:25 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0" returned: 0 in 0.842s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:25 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae 1G Jul 03 13:55:25 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:26 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae 1G" returned: 0 in 0.955s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca8438b9-9474-4860-871e-3b453667f5e0 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:26 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca8438b9-9474-4860-871e-3b453667f5e0 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae Jul 03 13:55:26 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca8438b9-9474-4860-871e-3b453667f5e0 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae" returned: 0 in 0.825s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:27 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:55:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:27 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:27 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae Jul 03 13:55:27 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:27 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-f3ee55c3-9880-42cc-8f83-88bf94e9fd58 req-63f8f407-f454-4278-bb47-8b3ea6fae3da tempest-AttachVolumeTestJSON-798433461 None] Terminate volume connection completed successfully. Jul 03 13:55:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-f3ee55c3-9880-42cc-8f83-88bf94e9fd58 req-63f8f407-f454-4278-bb47-8b3ea6fae3da tempest-AttachVolumeTestJSON-798433461 None] Deleting attachment e91d81e1-db85-4a3e-b4c9-7fe15ac1394e. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:55:28 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae" returned: 0 in 0.817s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:28 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.info Jul 03 13:55:28 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:28 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.info" returned: 0 in 0.728s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:29 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:55:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:29 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.info Jul 03 13:55:29 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:29 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.info" returned: 0 in 0.868s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.132s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Creating offline snapshot c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35 of volume 5a6e6c5e-ec68-436b-997f-6adfdde00949 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:55:29 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ca15c5-7e87-4436-b244-8d8d6cae6cdb]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:30 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949 Jul 03 13:55:30 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:30 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949" returned: 0 in 1.009s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:31 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35 1G Jul 03 13:55:31 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:32 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35 1G" returned: 0 in 1.051s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a6e6c5e-ec68-436b-997f-6adfdde00949 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:32 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a6e6c5e-ec68-436b-997f-6adfdde00949 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35 Jul 03 13:55:32 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:32 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=91,cinder:UPDATE=57,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:55:32 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-af4fadd0-1d96-46e9-a130-0e8eeae9f9f0 req-7e8f0bed-b9c1-422c-b366-9f02ccc55f86 tempest-ServerActionsTestOtherA-587473982 None] Terminate volume connection completed successfully. Jul 03 13:55:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-af4fadd0-1d96-46e9-a130-0e8eeae9f9f0 req-7e8f0bed-b9c1-422c-b366-9f02ccc55f86 tempest-ServerActionsTestOtherA-587473982 None] Deleting attachment 76ebdfac-55e6-4508-82ce-c480a3b90adf. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:55:32 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a6e6c5e-ec68-436b-997f-6adfdde00949 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35" returned: 0 in 0.946s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:33 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:55:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:33 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35 Jul 03 13:55:33 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:33 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35" returned: 0 in 0.781s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:33 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.info Jul 03 13:55:33 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:34 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.info" returned: 0 in 0.703s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:34 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:55:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:34 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.info Jul 03 13:55:34 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:35 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.info" returned: 0 in 0.774s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.422s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:35 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-5438fbd5-71d5-4287-85a5-50ed872eea7c tempest-GroupSnapshotsTest-1566434193 None] group_snapshot a7cfa1b0-cdc6-4d59-8da3-af1299226dea: created successfully Jul 03 13:55:36 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] group_snapshot a7cfa1b0-cdc6-4d59-8da3-af1299226dea: deleting Jul 03 13:55:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] group_snapshot a7cfa1b0-cdc6-4d59-8da3-af1299226dea: deleting {{(pid=86805) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 13:55:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "cinder-quobyte-ca8438b9-9474-4860-871e-3b453667f5e0" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-ca8438b9-9474-4860-871e-3b453667f5e0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "cinder-quobyte-8e29580b-b300-42f3-9d4f-54a602b32bae" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-8e29580b-b300-42f3-9d4f-54a602b32bae" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Deleting offline snapshot 8e29580b-b300-42f3-9d4f-54a602b32bae of volume ca8438b9-9474-4860-871e-3b453667f5e0 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:55:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] snapshot_file for this snap is: volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:55:36 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[be71ceef-c8a9-4d60-b948-7f6fdf7c3943]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:36 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae Jul 03 13:55:36 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:37 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae" returned: 0 in 0.859s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca8438b9-9474-4860-871e-3b453667f5e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:55:37 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cc0df8-d71f-49f3-ab8b-4c6b85b8fd77]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:37 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0 Jul 03 13:55:37 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:38 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0" returned: 0 in 1.009s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:38 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae Jul 03 13:55:38 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:39 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae" returned: 0 in 0.956s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:39 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae Jul 03 13:55:39 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:40 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0.8e29580b-b300-42f3-9d4f-54a602b32bae" returned: 0 in 0.836s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-8e29580b-b300-42f3-9d4f-54a602b32bae" released by "_delete_snapshot" :: held 3.814s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-ca8438b9-9474-4860-871e-3b453667f5e0" released by "delete_snapshot" :: held 3.840s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "cinder-quobyte-5a6e6c5e-ec68-436b-997f-6adfdde00949" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-5a6e6c5e-ec68-436b-997f-6adfdde00949" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "cinder-quobyte-c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Deleting offline snapshot c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35 of volume 5a6e6c5e-ec68-436b-997f-6adfdde00949 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:55:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] snapshot_file for this snap is: volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:55:40 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9a2c1e-b99e-4c01-8307-c65fca639c1b]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:40 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35 Jul 03 13:55:40 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:41 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35" returned: 0 in 1.410s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a6e6c5e-ec68-436b-997f-6adfdde00949(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:55:42 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1ead16-cc3b-40b0-8de1-29d8a67919fc]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:42 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949 Jul 03 13:55:42 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:43 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949" returned: 0 in 1.310s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:43 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35 Jul 03 13:55:43 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:45 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35" returned: 0 in 1.660s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:45 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35 Jul 03 13:55:45 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:46 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949.c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35" returned: 0 in 1.434s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:46 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-c1f07a82-8a8e-4cb6-9682-9d26e1c3ab35" released by "_delete_snapshot" :: held 6.026s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:46 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-5a6e6c5e-ec68-436b-997f-6adfdde00949" released by "delete_snapshot" :: held 6.058s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:46 devstack cinder-volume[86805]: WARNING cinder.quota [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-466694876 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-466694876, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:55:46 devstack cinder-volume[86805]: WARNING cinder.quota [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-466694876 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-466694876, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:55:46 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Created reservations ['e69704a2-ec17-4ec3-b7fd-51d610fb35e7', 'd6b95658-1a46-44cc-946c-e1eb90f29ccc', '8dc36501-949d-4690-8fcf-d7bf7bf98d0c', '9cc11ded-526f-4971-b318-bb8949a7213d'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:55:46 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] Created reservations ['594dad59-8fe2-4808-a248-2c18cd8fd260', '9715f7f4-9d59-4ba6-a9e2-beff45c3aa1b', 'ba34579c-94a1-4e9a-9666-d117dce0ecc2', '6d18e26e-fc30-4c06-b154-051da86df413'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:55:47 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-df373e31-1755-40de-a8ba-c9d3e99ca8f8 tempest-GroupSnapshotsTest-1566434193 None] group_snapshot a7cfa1b0-cdc6-4d59-8da3-af1299226dea: deleted successfully Jul 03 13:55:48 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] Acquiring lock "cinder-c0d129bb-ca39-457f-a630-577696dfbe36-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:48 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] Lock "cinder-c0d129bb-ca39-457f-a630-577696dfbe36-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:48 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] Acquiring lock "cinder-quobyte-c0d129bb-ca39-457f-a630-577696dfbe36" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:48 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] Lock "cinder-quobyte-c0d129bb-ca39-457f-a630-577696dfbe36" acquired by "delete_volume" :: waited 0.053s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:48 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d16c1d3-aac7-46b5-8704-55f7f66869d5]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:48 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "cinder-quobyte-5a6e6c5e-ec68-436b-997f-6adfdde00949" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:48 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-5a6e6c5e-ec68-436b-997f-6adfdde00949" acquired by "delete_volume" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:48 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c675af59-ccce-43b9-ae08-ac6e4c475ec7]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:48 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36 Jul 03 13:55:48 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:48 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949 Jul 03 13:55:48 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:49 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36" returned: 0 in 1.102s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:49 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36 Jul 03 13:55:49 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:49 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949" returned: 0 in 1.240s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:50 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949 Jul 03 13:55:50 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:50 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c0d129bb-ca39-457f-a630-577696dfbe36" returned: 0 in 0.781s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] Lock "cinder-quobyte-c0d129bb-ca39-457f-a630-577696dfbe36" released by "delete_volume" :: held 1.972s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:50 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] Created reservations ['3be825ed-aff1-442f-8d4a-3147748cfe25', 'a91ff525-00cc-4fc3-9187-82a954f16cad', '263d2772-524f-443e-a046-4e217c2e7b6e', '44e9665e-4a16-4818-9d09-d8c171a6c186'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:55:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:55:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:55:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:50 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:55:50 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:50 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5a6e6c5e-ec68-436b-997f-6adfdde00949" returned: 0 in 0.932s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-5a6e6c5e-ec68-436b-997f-6adfdde00949" released by "delete_volume" :: held 2.278s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "cinder-quobyte-ca8438b9-9474-4860-871e-3b453667f5e0" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-ca8438b9-9474-4860-871e-3b453667f5e0" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:51 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10d4c9f-d635-41ae-90b5-63107afc1003]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:51 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0 Jul 03 13:55:51 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:51 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.140s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:51 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:55:51 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] Deleted volume successfully. Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e4b9dd1a-48d1-4f4d-b80c-fabaaedd50b8 tempest-ServerActionsTestOtherA-587473982 None] Lock "cinder-c0d129bb-ca39-457f-a630-577696dfbe36-delete_volume" released by "delete_volume" :: held 3.670s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:52 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0" returned: 0 in 1.254s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:52 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0 Jul 03 13:55:52 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Flow 'volume_create_manager' (73db486c-15a6-42d2-9f53-9dc9b1e0f43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689cc59b-18dd-4e9f-b2dd-1efec738ef7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689cc59b-18dd-4e9f-b2dd-1efec738ef7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1134169263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2452abeb-e139-4a3e-927e-08240e1c1ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56bddc84dace489aae3d28feef614b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:55:53Z,use_quota=True,user_id='bfd332c3fd0a491c874379b0134f1d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfd6242-3c4f-4183-aa27-f2d41ef137fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfd6242-3c4f-4183-aa27-f2d41ef137fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14de0e6-fe03-4c40-9180-f3947a5ccece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14de0e6-fe03-4c40-9180-f3947a5ccece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2452abeb-e139-4a3e-927e-08240e1c1ccb', 'volume_name': 'volume-2452abeb-e139-4a3e-927e-08240e1c1ccb', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a2788a-8519-4541-9d81-ed729ef8c8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a2788a-8519-4541-9d81-ed729ef8c8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afa7674-16bf-418e-8ffd-09e6bd265e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:52 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Volume 2452abeb-e139-4a3e-927e-08240e1c1ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2452abeb-e139-4a3e-927e-08240e1c1ccb', 'volume_size': 1} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1134169263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2452abeb-e139-4a3e-927e-08240e1c1ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56bddc84dace489aae3d28feef614b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:55:53Z,use_quota=True,user_id='bfd332c3fd0a491c874379b0134f1d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Creating volume 2452abeb-e139-4a3e-927e-08240e1c1ccb {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:55:52 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:55:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2452abeb-e139-4a3e-927e-08240e1c1ccb 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:52 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2452abeb-e139-4a3e-927e-08240e1c1ccb 1073741824 Jul 03 13:55:52 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:53 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ca8438b9-9474-4860-871e-3b453667f5e0" returned: 0 in 0.937s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-ca8438b9-9474-4860-871e-3b453667f5e0" released by "delete_volume" :: held 2.320s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:53 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Created reservations ['f0faac9d-78df-45a9-8a8b-2ed2b2a788cc'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:55:53 devstack cinder-volume[86805]: WARNING cinder.quota [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-466694876 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-466694876, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:55:53 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Created reservations ['223e2673-8104-44c6-a7a0-f9a309e31a05', '9649a5c6-af95-4dd1-823b-5f407e123172', '79742ca0-bf2c-4a27-99ff-c42f2573360a', '38c29569-869c-43bc-a3c1-0327539ccaac'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:55:53 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Created reservations ['a3b37c90-7de2-45d3-8540-3b011bcba105', '85f87471-96b6-4927-a8e2-6011c333267a', 'f94bebe3-70c6-4f47-84bf-76bb6510038d', '49188af4-1a42-448b-a46d-6b6141fcdbd8'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:55:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:55:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:55:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:53 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:55:53 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:54 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2452abeb-e139-4a3e-927e-08240e1c1ccb 1073741824" returned: 0 in 1.533s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2452abeb-e139-4a3e-927e-08240e1c1ccb {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:54 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2452abeb-e139-4a3e-927e-08240e1c1ccb Jul 03 13:55:54 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:54 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-749d36d0-3b0e-4d77-9d96-50d32c9758ca tempest-GroupSnapshotsTest-1566434193 None] Group tempest-GroupSnapshotsTest-Group-1383549193: creating Jul 03 13:55:54 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-749d36d0-3b0e-4d77-9d96-50d32c9758ca tempest-GroupSnapshotsTest-1566434193 None] Group tempest-GroupSnapshotsTest-Group-1383549193: created successfully Jul 03 13:55:54 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-749d36d0-3b0e-4d77-9d96-50d32c9758ca tempest-GroupSnapshotsTest-1566434193 None] Create group completed successfully. Jul 03 13:55:55 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.154s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:55 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:55:55 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b46004db-34e9-4fe4-b7e2-dfa62cad37d3 tempest-GroupSnapshotsTest-1566434193 None] Delete group completed successfully. Jul 03 13:55:55 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2452abeb-e139-4a3e-927e-08240e1c1ccb" returned: 0 in 1.027s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] <== create_volume: return (2627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:55:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.632s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afa7674-16bf-418e-8ffd-09e6bd265e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2452abeb-e139-4a3e-927e-08240e1c1ccb', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a399e49e-c963-4c01-a2eb-7c4b30d236a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:55 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Volume volume-2452abeb-e139-4a3e-927e-08240e1c1ccb (2452abeb-e139-4a3e-927e-08240e1c1ccb): created successfully Jul 03 13:55:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a399e49e-c963-4c01-a2eb-7c4b30d236a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Flow 'volume_create_manager' (73db486c-15a6-42d2-9f53-9dc9b1e0f43e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:55:55 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-79de9f50-45ea-45aa-96e9-4d14f11f8576 tempest-TaggedAttachmentsTest-648184428 None] Created volume successfully. Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Flow 'volume_create_manager' (a32271e1-a831-40c6-88be-22f140eb9d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (518db1de-57ec-4a7a-bc66-67c1a26f5c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (518db1de-57ec-4a7a-bc66-67c1a26f5c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1358819184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f71f700-e261-41f9-9649-84fb2f0b95b5,host='devstack@QuobyteHD#QuobyteHD',id=de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15266b9ccd440c3b581601e084e9a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:55:56Z,use_quota=True,user_id='6c750c37ca454a47a32f5b46e528dd01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b60b3c6b-7176-4420-8978-5dea909a4d32),volume_type_id=b60b3c6b-7176-4420-8978-5dea909a4d32)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29df237-ef48-4e3a-82ab-bb7c27428e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29df237-ef48-4e3a-82ab-bb7c27428e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (714f3bdd-f817-4f5b-b7d8-ea99cd26189f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (714f3bdd-f817-4f5b-b7d8-ea99cd26189f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a', 'volume_name': 'volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedc98ce-af70-4e81-a8f5-7eb9b528e7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedc98ce-af70-4e81-a8f5-7eb9b528e7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff8751e-dead-4729-acae-4867575558ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:56 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Volume de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a', 'volume_size': 1} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1f71f700-e261-41f9-9649-84fb2f0b95b5,created_at=2026-07-03T11:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1358819184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f71f700-e261-41f9-9649-84fb2f0b95b5,host='devstack@QuobyteHD#QuobyteHD',id=de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15266b9ccd440c3b581601e084e9a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:55:56Z,use_quota=True,user_id='6c750c37ca454a47a32f5b46e528dd01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b60b3c6b-7176-4420-8978-5dea909a4d32),volume_type_id=b60b3c6b-7176-4420-8978-5dea909a4d32)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Creating volume de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:55:56 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:55:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:56 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a 1073741824 Jul 03 13:55:56 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:57 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a 1073741824" returned: 0 in 0.918s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:57 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a Jul 03 13:55:57 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:58 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a" returned: 0 in 0.755s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:55:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff8751e-dead-4729-acae-4867575558ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1075a980-e73f-442f-b1fb-435d9108766f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:58 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Volume volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a (de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a): created successfully Jul 03 13:55:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1075a980-e73f-442f-b1fb-435d9108766f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Flow 'volume_create_manager' (a32271e1-a831-40c6-88be-22f140eb9d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:55:58 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-0b0a116c-a403-42b8-9004-b4eb28190463 tempest-GroupSnapshotsTest-1566434193 None] Created volume successfully. Jul 03 13:55:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:55:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:55:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:55:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:58 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:55:58 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:59 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.715s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:55:59 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] GroupSnapshot 76e1dfb1-132d-4960-aef6-e5dd95f14c9d: creating. Jul 03 13:55:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] Group snapshot 76e1dfb1-132d-4960-aef6-e5dd95f14c9d: creating. {{(pid=86805) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 13:55:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] Creating offline snapshot 2f89fbe4-8e7f-43d6-8af3-a3028f5269b0 of volume de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:55:59 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5d4c1d-df97-4fee-a3e4-f2e4d6395aa6]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:59 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a Jul 03 13:55:59 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:00 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a" returned: 0 in 0.887s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:00 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0 1G Jul 03 13:56:00 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:00 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0 1G" returned: 0 in 0.859s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:01 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0 Jul 03 13:56:01 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:01 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0" returned: 0 in 0.758s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:01 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:56:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:01 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0 Jul 03 13:56:01 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:02 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0" returned: 0 in 0.753s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:02 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.info Jul 03 13:56:02 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:03 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.info" returned: 0 in 0.790s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:03 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:56:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:03 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.info Jul 03 13:56:03 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:04 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.info" returned: 0 in 0.790s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.954s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:04 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-84ab060e-0e1b-4bfd-93b3-d50928799272 tempest-GroupSnapshotsTest-1566434193 None] group_snapshot 76e1dfb1-132d-4960-aef6-e5dd95f14c9d: created successfully Jul 03 13:56:04 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] group_snapshot 76e1dfb1-132d-4960-aef6-e5dd95f14c9d: deleting Jul 03 13:56:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] group_snapshot 76e1dfb1-132d-4960-aef6-e5dd95f14c9d: deleting {{(pid=86805) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 13:56:04 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "cinder-quobyte-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:04 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:04 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "cinder-quobyte-2f89fbe4-8e7f-43d6-8af3-a3028f5269b0" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:04 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-2f89fbe4-8e7f-43d6-8af3-a3028f5269b0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] Deleting offline snapshot 2f89fbe4-8e7f-43d6-8af3-a3028f5269b0 of volume de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:56:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] snapshot_file for this snap is: volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:56:04 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e571ba-ed29-40fa-a0d2-0ace3db7e63d]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:04 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0 Jul 03 13:56:04 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:05 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0" returned: 0 in 1.093s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:56:05 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2698ab-9ad5-42ad-aa2e-6eea5206ae3f]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:06 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a Jul 03 13:56:06 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:07 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a" returned: 0 in 1.200s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:07 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0 Jul 03 13:56:07 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:07 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0" returned: 0 in 0.848s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:08 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0 Jul 03 13:56:08 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:09 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a.2f89fbe4-8e7f-43d6-8af3-a3028f5269b0" returned: 0 in 1.060s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-2f89fbe4-8e7f-43d6-8af3-a3028f5269b0" released by "_delete_snapshot" :: held 4.343s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a" released by "delete_snapshot" :: held 4.375s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:09 devstack cinder-volume[86805]: WARNING cinder.quota [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1062509031 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1062509031, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:56:09 devstack cinder-volume[86805]: WARNING cinder.quota [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1062509031 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1062509031, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:56:09 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] Created reservations ['8d2c8345-7649-4858-a34a-99588261f914', '5ea42f43-9208-4640-b31f-71be4a137604', '5cdb1138-e9ce-4a95-bc8a-67ac4a5555f7', '3ba518b1-c96d-47a3-94e3-7a785a2415d9'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:09 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-66ddde03-eb5c-4578-b6cb-94bf292dc9d4 tempest-GroupSnapshotsTest-1566434193 None] group_snapshot 76e1dfb1-132d-4960-aef6-e5dd95f14c9d: deleted successfully Jul 03 13:56:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "cinder-quobyte-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a" acquired by "delete_volume" :: waited 0.030s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:10 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea8b2a2-19a9-4162-8a5c-33f6c36bd9ec]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:10 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a Jul 03 13:56:10 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:11 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a" returned: 0 in 0.824s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:11 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a Jul 03 13:56:11 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:12 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a" returned: 0 in 0.802s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] Lock "cinder-quobyte-de8cf1bc-2adb-4c76-8c21-8d3df56f1c3a" released by "delete_volume" :: held 1.722s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:12 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] Created reservations ['66e67abe-e353-46ed-b7b5-c0a1f480d354'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:12 devstack cinder-volume[86805]: WARNING cinder.quota [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1062509031 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1062509031, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:56:12 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] Created reservations ['b9dfe304-d9c6-4b37-bed1-0ddfdd62e9b6', '818ae260-44f8-4792-b593-b15e88ad96f4', 'c78f8416-8cf9-4e36-b678-2f10ddb40c1e', '4b0540be-0edb-470c-92d6-821dd1169d78'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:12 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:56:12 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:14 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.572s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:14 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:56:14 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ef456d99-55d2-488e-b5fc-1ee796900af6 tempest-GroupSnapshotsTest-1566434193 None] Delete group completed successfully. Jul 03 13:56:22 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=66,cinder:INSERT=20,cinder:SELECT=70,cinder:DELETE=1 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:56:22 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=74,cinder:SELECT=69,cinder:INSERT=14,cinder:DELETE=2 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:56:25 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e7f0999d-6569-481b-9499-66da2434824d tempest-GroupsV314Test-1553183413 None] Group tempest-GroupsV314Test-Group-343184172: creating Jul 03 13:56:25 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e7f0999d-6569-481b-9499-66da2434824d tempest-GroupsV314Test-1553183413 None] Group tempest-GroupsV314Test-Group-343184172: created successfully Jul 03 13:56:25 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e7f0999d-6569-481b-9499-66da2434824d tempest-GroupsV314Test-1553183413 None] Create group completed successfully. Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Flow 'volume_create_manager' (4cd1c475-73cd-429f-94c4-8fe7e3143119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062766f6-916a-4697-952a-c87f352cc95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062766f6-916a-4697-952a-c87f352cc95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1416048975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d412a8e1-9832-4607-9a5f-9e3cb807729a,host='devstack@QuobyteHD#QuobyteHD',id=fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8253e24f244b4a6084272ebbcb4ac024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:27Z,use_quota=True,user_id='344d5c4588914bd58bed98615a6e23b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afb31570-3e43-4091-8af7-7db1e0515d1a),volume_type_id=afb31570-3e43-4091-8af7-7db1e0515d1a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e85e1dc-9f57-42f2-95e9-d05348898b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e85e1dc-9f57-42f2-95e9-d05348898b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3e6711-de79-42e5-9e11-46e43e76dd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3e6711-de79-42e5-9e11-46e43e76dd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80', 'volume_name': 'volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc3f1b3-10e0-4674-ade1-303df7718113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc3f1b3-10e0-4674-ade1-303df7718113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90758460-6ff9-40df-9dfa-936532e4725d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:27 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Volume fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80', 'volume_size': 1} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d412a8e1-9832-4607-9a5f-9e3cb807729a,created_at=2026-07-03T11:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1416048975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d412a8e1-9832-4607-9a5f-9e3cb807729a,host='devstack@QuobyteHD#QuobyteHD',id=fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8253e24f244b4a6084272ebbcb4ac024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:27Z,use_quota=True,user_id='344d5c4588914bd58bed98615a6e23b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afb31570-3e43-4091-8af7-7db1e0515d1a),volume_type_id=afb31570-3e43-4091-8af7-7db1e0515d1a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Creating volume fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:56:27 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:56:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:27 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 1073741824 Jul 03 13:56:27 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:28 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 1073741824" returned: 0 in 0.911s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:28 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 Jul 03 13:56:28 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:28 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80" returned: 0 in 0.644s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:56:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90758460-6ff9-40df-9dfa-936532e4725d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92430534-e130-446d-89c8-939716566944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:28 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Volume volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 (fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80): created successfully Jul 03 13:56:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92430534-e130-446d-89c8-939716566944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Flow 'volume_create_manager' (4cd1c475-73cd-429f-94c4-8fe7e3143119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-47db1a86-626a-4418-b5ef-5760a1070926 tempest-GroupsV314Test-1553183413 None] Created volume successfully. Jul 03 13:56:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:30 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Cloning volume fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 to volume 520f4de8-76eb-4536-9092-e1a6ed4ab3d7 Jul 03 13:56:30 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Creating offline snapshot efe43dbf-8925-4a35-8750-c56d747d2906 of volume fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:56:30 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f91bc76-d8fe-4dd9-859c-11870e3fc6f8]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:30 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 Jul 03 13:56:30 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:31 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80" returned: 0 in 0.860s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:31 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906 1G Jul 03 13:56:31 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:32 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906 1G" returned: 0 in 0.982s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:32 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906 Jul 03 13:56:32 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:33 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906" returned: 0 in 0.855s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:33 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:56:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:33 devstack sudo[91244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906 Jul 03 13:56:33 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:34 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906" returned: 0 in 1.189s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:34 devstack sudo[91266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.info Jul 03 13:56:34 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:35 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.info" returned: 0 in 0.898s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:35 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:56:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:35 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.info Jul 03 13:56:35 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:36 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.info" returned: 0 in 0.881s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Acquiring lock "cinder-quobyte-520f4de8-76eb-4536-9092-e1a6ed4ab3d7" by "_copy_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Lock "cinder-quobyte-520f4de8-76eb-4536-9092-e1a6ed4ab3d7" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] snapshot: efe43dbf-8925-4a35-8750-c56d747d2906, volume: 520f4de8-76eb-4536-9092-e1a6ed4ab3d7, {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 13:56:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:36 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84adf05-160d-45f4-b854-a5edd312b81b]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:36 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906 Jul 03 13:56:36 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:37 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906" returned: 0 in 1.001s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:56:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] will copy from snapshot at /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 13:56:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Creating direct copy from snapshot {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 13:56:37 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b9de65-4251-4bb4-aea9-bd6b3df21c5f]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:37 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 Jul 03 13:56:37 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:39 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80" returned: 0 in 1.596s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:39 devstack cinder-volume[86805]: DEBUG cinder.utils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Path /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-520f4de8-76eb-4536-9092-e1a6ed4ab3d7 not found in is_blk_device check {{(pid=86805) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 13:56:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-520f4de8-76eb-4536-9092-e1a6ed4ab3d7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:39 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-520f4de8-76eb-4536-9092-e1a6ed4ab3d7 Jul 03 13:56:39 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:44 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:56:44 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:INSERT=2 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:56:52 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-520f4de8-76eb-4536-9092-e1a6ed4ab3d7" returned: 0 in 12.970s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:52 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c31328-e1af-4b57-9472-cfef447642e4]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:52 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 Jul 03 13:56:52 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:54 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80" returned: 0 in 2.753s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:54 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Image conversion details: src /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80, size 1024.00 MB, duration 12.97 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-520f4de8-76eb-4536-9092-e1a6ed4ab3d7 {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:56:54 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Converted 1024.00 MB image at 78.94 MB/s Jul 03 13:56:54 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-520f4de8-76eb-4536-9092-e1a6ed4ab3d7 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:56:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-520f4de8-76eb-4536-9092-e1a6ed4ab3d7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:55 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-520f4de8-76eb-4536-9092-e1a6ed4ab3d7 Jul 03 13:56:55 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:56 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-520f4de8-76eb-4536-9092-e1a6ed4ab3d7" returned: 0 in 2.025s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Lock "cinder-quobyte-520f4de8-76eb-4536-9092-e1a6ed4ab3d7" released by "_copy_volume_from_snapshot" :: held 20.499s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Acquiring lock "cinder-quobyte-efe43dbf-8925-4a35-8750-c56d747d2906" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Lock "cinder-quobyte-efe43dbf-8925-4a35-8750-c56d747d2906" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:57 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Deleting offline snapshot efe43dbf-8925-4a35-8750-c56d747d2906 of volume fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:56:57 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] snapshot_file for this snap is: volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:56:57 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c653db6f-b9dc-4595-a409-288ce8c70d97]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:57 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906 Jul 03 13:56:57 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:56:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:58 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:56:58 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:59 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906" returned: 0 in 2.106s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:56:59 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e95df3-38bc-469e-86ba-e50e80ce1509]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:59 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 Jul 03 13:56:59 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-0a0d2165-a122-4e26-a118-0141d31727db req-5b39f974-031e-4a20-9f69-8bc4991229a8 tempest-TaggedAttachmentsTest-648184428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:00 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.815s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:00 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:57:00 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80" returned: 0 in 1.270s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:00 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906 Jul 03 13:57:00 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:01 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906" returned: 0 in 0.764s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:01 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906 Jul 03 13:57:01 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:01 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80.efe43dbf-8925-4a35-8750-c56d747d2906" returned: 0 in 0.683s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:02 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Lock "cinder-quobyte-efe43dbf-8925-4a35-8750-c56d747d2906" released by "_delete_snapshot" :: held 4.994s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 31.489s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-0a0d2165-a122-4e26-a118-0141d31727db req-5b39f974-031e-4a20-9f69-8bc4991229a8 tempest-TaggedAttachmentsTest-648184428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.388s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:02 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bec209-b2fc-40bb-b942-b725b03d8736]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-0a0d2165-a122-4e26-a118-0141d31727db req-5b39f974-031e-4a20-9f69-8bc4991229a8 tempest-TaggedAttachmentsTest-648184428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2452abeb-e139-4a3e-927e-08240e1c1ccb {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:02 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-49825f99-de65-411c-af99-56761b3aa0c0 tempest-GroupsV314Test-1553183413 None] Create group from source-group-d412a8e1-9832-4607-9a5f-9e3cb807729a completed successfully. Jul 03 13:57:02 devstack sudo[91759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2452abeb-e139-4a3e-927e-08240e1c1ccb Jul 03 13:57:02 devstack sudo[91759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:02 devstack sudo[91759]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-0a0d2165-a122-4e26-a118-0141d31727db req-5b39f974-031e-4a20-9f69-8bc4991229a8 tempest-TaggedAttachmentsTest-648184428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2452abeb-e139-4a3e-927e-08240e1c1ccb" returned: 0 in 0.855s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-0a0d2165-a122-4e26-a118-0141d31727db req-5b39f974-031e-4a20-9f69-8bc4991229a8 tempest-TaggedAttachmentsTest-648184428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.891s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-0a0d2165-a122-4e26-a118-0141d31727db req-5b39f974-031e-4a20-9f69-8bc4991229a8 tempest-TaggedAttachmentsTest-648184428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-2452abeb-e139-4a3e-927e-08240e1c1ccb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd688c89d-08ee-4567-a8e6-b189102eaac4', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:57:03 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-0a0d2165-a122-4e26-a118-0141d31727db req-5b39f974-031e-4a20-9f69-8bc4991229a8 tempest-TaggedAttachmentsTest-648184428 None] attachment_update completed successfully. Jul 03 13:57:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] Acquiring lock "cinder-quobyte-520f4de8-76eb-4536-9092-e1a6ed4ab3d7" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] Lock "cinder-quobyte-520f4de8-76eb-4536-9092-e1a6ed4ab3d7" acquired by "delete_volume" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:03 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f74303e-cdcf-4857-9f73-2047624d7669]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-520f4de8-76eb-4536-9092-e1a6ed4ab3d7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:04 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-520f4de8-76eb-4536-9092-e1a6ed4ab3d7 Jul 03 13:57:04 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:05 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-520f4de8-76eb-4536-9092-e1a6ed4ab3d7" returned: 0 in 1.692s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-520f4de8-76eb-4536-9092-e1a6ed4ab3d7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:05 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-520f4de8-76eb-4536-9092-e1a6ed4ab3d7 Jul 03 13:57:05 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:06 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-520f4de8-76eb-4536-9092-e1a6ed4ab3d7" returned: 0 in 1.119s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] Lock "cinder-quobyte-520f4de8-76eb-4536-9092-e1a6ed4ab3d7" released by "delete_volume" :: held 2.865s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:06 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] Created reservations ['c40bb97f-9d0d-4be6-a271-4b406187b540'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:57:06 devstack cinder-volume[86805]: WARNING cinder.quota [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1674188836 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1674188836, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:57:06 devstack cinder-volume[86805]: WARNING cinder.quota [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1674188836 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1674188836, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:57:06 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] Created reservations ['98eb2c38-5faf-4ac7-bdf4-baafb5089805', 'ae483533-beb2-4599-8ca4-150bbdad8d50', 'a8c7c058-b5b6-415a-9371-ecf193ef1ba3', '6907251c-a74d-49e1-903d-8d96e3c09186'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:57:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:06 devstack sudo[92216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:57:06 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:07 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.717s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:07 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:57:07 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-cd84944c-548b-4eb4-8dab-bfc17e77e32d tempest-GroupsV314Test-1553183413 None] Delete group completed successfully. Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] Acquiring lock "cinder-quobyte-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Flow 'volume_create_manager' (735ab3c0-5b84-491b-962a-5b2b3f5533c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9507b9-e530-4a4b-8349-a517ae3701f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] Lock "cinder-quobyte-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80" acquired by "delete_volume" :: waited 0.060s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9507b9-e530-4a4b-8349-a517ae3701f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-661703544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1533b4-754e-42f3-bd9f-bd35154a5a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2df45efc1bd45889aacc1e3458c20d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:08Z,use_quota=True,user_id='2267072230374f6fb1344ca405bddf7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8112fa70-aa11-41b6-aeb0-ebb2df5ef86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8112fa70-aa11-41b6-aeb0-ebb2df5ef86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d2a7db-1817-486d-a34b-84a4a5336573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d2a7db-1817-486d-a34b-84a4a5336573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a1533b4-754e-42f3-bd9f-bd35154a5a98', 'volume_name': 'volume-9a1533b4-754e-42f3-bd9f-bd35154a5a98', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bc0f2e-1cb1-4e8c-a3e7-4e2cbb3d53b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bc0f2e-1cb1-4e8c-a3e7-4e2cbb3d53b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5656a9-3c49-496d-ad1b-60ca6baf6065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:08 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Volume 9a1533b4-754e-42f3-bd9f-bd35154a5a98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a1533b4-754e-42f3-bd9f-bd35154a5a98', 'volume_size': 1} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-661703544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1533b4-754e-42f3-bd9f-bd35154a5a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2df45efc1bd45889aacc1e3458c20d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:08Z,use_quota=True,user_id='2267072230374f6fb1344ca405bddf7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Creating volume 9a1533b4-754e-42f3-bd9f-bd35154a5a98 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:57:08 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9a1533b4-754e-42f3-bd9f-bd35154a5a98 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8190b268-480d-4779-8f2f-d36f16457fe9]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:08 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9a1533b4-754e-42f3-bd9f-bd35154a5a98 1073741824 Jul 03 13:57:08 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:08 devstack sudo[92224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 Jul 03 13:57:08 devstack sudo[92224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:09 devstack sudo[92224]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80" returned: 0 in 1.082s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:09 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80 Jul 03 13:57:09 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:09 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9a1533b4-754e-42f3-bd9f-bd35154a5a98 1073741824" returned: 0 in 1.174s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9a1533b4-754e-42f3-bd9f-bd35154a5a98 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:09 devstack sudo[92238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9a1533b4-754e-42f3-bd9f-bd35154a5a98 Jul 03 13:57:09 devstack sudo[92238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:10 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80" returned: 0 in 0.705s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] Lock "cinder-quobyte-fc49b3ab-5a0f-4eb7-89fc-4556b2a32b80" released by "delete_volume" :: held 1.953s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] Created reservations ['ed35977a-3eae-4639-a274-9d0ad6217c5e'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] Created reservations ['6663c84b-34ff-4ed8-8ff0-ef20fa272a64', 'c547afdc-05e2-4f73-a508-660454a9cb7c', 'dba1b640-0f23-4051-8ff8-62178391eafc', '88a65431-a4f0-428a-b29b-9f24c29dd7fa'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:57:10 devstack sudo[92238]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9a1533b4-754e-42f3-bd9f-bd35154a5a98" returned: 0 in 0.838s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5656a9-3c49-496d-ad1b-60ca6baf6065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a1533b4-754e-42f3-bd9f-bd35154a5a98', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (898d2d03-4db4-417b-936a-41cc7dd457fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:10 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Volume volume-9a1533b4-754e-42f3-bd9f-bd35154a5a98 (9a1533b4-754e-42f3-bd9f-bd35154a5a98): created successfully Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (898d2d03-4db4-417b-936a-41cc7dd457fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Flow 'volume_create_manager' (735ab3c0-5b84-491b-962a-5b2b3f5533c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:10 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-22923f06-8136-436a-aa5e-8bd33b19aad3 tempest-ServerRescueNegativeTestJSON-298804928 None] Created volume successfully. Jul 03 13:57:10 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-707af7de-2dc6-4ca3-be5e-99d364e7a114 req-1548e639-bd67-4839-9144-569480e10d29 tempest-TaggedAttachmentsTest-648184428 None] Terminate volume connection completed successfully. Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-707af7de-2dc6-4ca3-be5e-99d364e7a114 req-1548e639-bd67-4839-9144-569480e10d29 tempest-TaggedAttachmentsTest-648184428 None] Deleting attachment d688c89d-08ee-4567-a8e6-b189102eaac4. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:10 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:57:10 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:11 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.695s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:11 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:57:11 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-d59c92e1-36fa-46ad-aed2-ed26c0711947 tempest-GroupsV314Test-1553183413 None] Delete group completed successfully. Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Flow 'volume_create_manager' (962c6320-1d7b-4ebf-ae57-bd5acef2bba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfc282a-8e7f-4b3c-836b-92acdd0d7407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfc282a-8e7f-4b3c-836b-92acdd0d7407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1719043976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090efbe4-da9b-46e1-84a7-f36d367c0589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031eab72ce044daeb7e70c150f2d9909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:20Z,use_quota=True,user_id='deeec049ef2d418c8a650453432578d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4372acf-46b2-4465-84da-f017ca433bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4372acf-46b2-4465-84da-f017ca433bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b46886-8582-4157-a756-743ebf21e0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b46886-8582-4157-a756-743ebf21e0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '090efbe4-da9b-46e1-84a7-f36d367c0589', 'volume_name': 'volume-090efbe4-da9b-46e1-84a7-f36d367c0589', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33bdf3a4-2542-4d6c-a5a8-08f04b8ea35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33bdf3a4-2542-4d6c-a5a8-08f04b8ea35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcaad3cc-fc23-4da5-91cd-c9ad04f0d376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:19 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Volume 090efbe4-da9b-46e1-84a7-f36d367c0589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-090efbe4-da9b-46e1-84a7-f36d367c0589', 'volume_size': 1} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1719043976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090efbe4-da9b-46e1-84a7-f36d367c0589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031eab72ce044daeb7e70c150f2d9909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:20Z,use_quota=True,user_id='deeec049ef2d418c8a650453432578d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Creating volume 090efbe4-da9b-46e1-84a7-f36d367c0589 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:57:19 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:57:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-090efbe4-da9b-46e1-84a7-f36d367c0589 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:19 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-090efbe4-da9b-46e1-84a7-f36d367c0589 1073741824 Jul 03 13:57:19 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:21 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-090efbe4-da9b-46e1-84a7-f36d367c0589 1073741824" returned: 0 in 1.314s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-090efbe4-da9b-46e1-84a7-f36d367c0589 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:21 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-090efbe4-da9b-46e1-84a7-f36d367c0589 Jul 03 13:57:21 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:22 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-090efbe4-da9b-46e1-84a7-f36d367c0589" returned: 0 in 1.401s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] <== create_volume: return (2810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:57:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.812s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcaad3cc-fc23-4da5-91cd-c9ad04f0d376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-090efbe4-da9b-46e1-84a7-f36d367c0589', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec104d0c-9ade-4908-80a4-4ff8ac147c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:22 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Volume volume-090efbe4-da9b-46e1-84a7-f36d367c0589 (090efbe4-da9b-46e1-84a7-f36d367c0589): created successfully Jul 03 13:57:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec104d0c-9ade-4908-80a4-4ff8ac147c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Flow 'volume_create_manager' (962c6320-1d7b-4ebf-ae57-bd5acef2bba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:22 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-25e6e0c6-d20e-44e4-8c87-71149ea396a8 tempest-AttachVolumeTestJSON-798433461 None] Created volume successfully. Jul 03 13:57:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-4bf3cb00-482b-4abf-b439-56247e16ffaa req-c1f23366-3434-4955-b47f-6b6f786c8de6 tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-4bf3cb00-482b-4abf-b439-56247e16ffaa req-c1f23366-3434-4955-b47f-6b6f786c8de6 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:27 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc389768-4ea1-4d2e-9b16-3645719d613e]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-4bf3cb00-482b-4abf-b439-56247e16ffaa req-c1f23366-3434-4955-b47f-6b6f786c8de6 tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-090efbe4-da9b-46e1-84a7-f36d367c0589 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:27 devstack sudo[92500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-090efbe4-da9b-46e1-84a7-f36d367c0589 Jul 03 13:57:27 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:28 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-4bf3cb00-482b-4abf-b439-56247e16ffaa req-c1f23366-3434-4955-b47f-6b6f786c8de6 tempest-AttachVolumeTestJSON-798433461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-090efbe4-da9b-46e1-84a7-f36d367c0589" returned: 0 in 1.395s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-4bf3cb00-482b-4abf-b439-56247e16ffaa req-c1f23366-3434-4955-b47f-6b6f786c8de6 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.418s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-4bf3cb00-482b-4abf-b439-56247e16ffaa req-c1f23366-3434-4955-b47f-6b6f786c8de6 tempest-AttachVolumeTestJSON-798433461 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-090efbe4-da9b-46e1-84a7-f36d367c0589', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3e7678b-8484-49de-a0b0-0391ce4c62de', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:57:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-4bf3cb00-482b-4abf-b439-56247e16ffaa req-c1f23366-3434-4955-b47f-6b6f786c8de6 tempest-AttachVolumeTestJSON-798433461 None] attachment_update completed successfully. Jul 03 13:57:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] Acquiring lock "cinder-9a1533b4-754e-42f3-bd9f-bd35154a5a98-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] Lock "cinder-9a1533b4-754e-42f3-bd9f-bd35154a5a98-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] Acquiring lock "cinder-2452abeb-e139-4a3e-927e-08240e1c1ccb-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] Lock "cinder-2452abeb-e139-4a3e-927e-08240e1c1ccb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] Acquiring lock "cinder-quobyte-9a1533b4-754e-42f3-bd9f-bd35154a5a98" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] Acquiring lock "cinder-quobyte-2452abeb-e139-4a3e-927e-08240e1c1ccb" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] Lock "cinder-quobyte-9a1533b4-754e-42f3-bd9f-bd35154a5a98" acquired by "delete_volume" :: waited 0.035s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] Lock "cinder-quobyte-2452abeb-e139-4a3e-927e-08240e1c1ccb" acquired by "delete_volume" :: waited 0.065s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:33 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[740bfa34-63fe-4a68-a408-48f76994118d]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9a1533b4-754e-42f3-bd9f-bd35154a5a98 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:33 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4184dcde-f6cc-4b77-ae96-f58d7df34bf4]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2452abeb-e139-4a3e-927e-08240e1c1ccb {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:33 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9a1533b4-754e-42f3-bd9f-bd35154a5a98 Jul 03 13:57:33 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:33 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2452abeb-e139-4a3e-927e-08240e1c1ccb Jul 03 13:57:33 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:34 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2452abeb-e139-4a3e-927e-08240e1c1ccb" returned: 0 in 1.202s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2452abeb-e139-4a3e-927e-08240e1c1ccb {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:34 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2452abeb-e139-4a3e-927e-08240e1c1ccb Jul 03 13:57:34 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:34 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9a1533b4-754e-42f3-bd9f-bd35154a5a98" returned: 0 in 1.601s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9a1533b4-754e-42f3-bd9f-bd35154a5a98 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:57:34 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9a1533b4-754e-42f3-bd9f-bd35154a5a98 Jul 03 13:57:34 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Flow 'volume_create_manager' (bd510a50-7333-4562-a303-e9f81f8bc7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765e49a0-bf26-4c4a-bdfb-4df46992f5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765e49a0-bf26-4c4a-bdfb-4df46992f5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-797047882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43fcaff1-0e66-4f40-8cae-96dc2a7e6222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031eab72ce044daeb7e70c150f2d9909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:35Z,use_quota=True,user_id='deeec049ef2d418c8a650453432578d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e3192d-5917-4785-87e3-27fee8a8fa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e3192d-5917-4785-87e3-27fee8a8fa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef64412c-61bd-4d7e-9f75-09c9aa20300b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef64412c-61bd-4d7e-9f75-09c9aa20300b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43fcaff1-0e66-4f40-8cae-96dc2a7e6222', 'volume_name': 'volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa397f2-9c0d-4198-8d6f-2205f200eda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa397f2-9c0d-4198-8d6f-2205f200eda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06668d1-979d-46a9-b388-be1d1ffbec3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:34 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Volume 43fcaff1-0e66-4f40-8cae-96dc2a7e6222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222', 'volume_size': 1} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-797047882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43fcaff1-0e66-4f40-8cae-96dc2a7e6222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031eab72ce044daeb7e70c150f2d9909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:35Z,use_quota=True,user_id='deeec049ef2d418c8a650453432578d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Creating volume 43fcaff1-0e66-4f40-8cae-96dc2a7e6222 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:57:34 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:57:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:34 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222 1073741824 Jul 03 13:57:34 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:35 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2452abeb-e139-4a3e-927e-08240e1c1ccb" returned: 0 in 1.049s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] Lock "cinder-quobyte-2452abeb-e139-4a3e-927e-08240e1c1ccb" released by "delete_volume" :: held 2.344s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:35 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] Created reservations ['c42d6fe2-8e89-4357-bab2-bc2a10baf169', '3b6838b3-1a20-42c0-9b43-0265d41fcbfe', '38a1a9d3-4985-4c4c-9a02-b33b430041a1', 'cba71bf1-75a6-49e3-a405-8d8353dd0099'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:57:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:35 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:35 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:35 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:57:35 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:36 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9a1533b4-754e-42f3-bd9f-bd35154a5a98" returned: 0 in 1.380s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] Lock "cinder-quobyte-9a1533b4-754e-42f3-bd9f-bd35154a5a98" released by "delete_volume" :: held 3.101s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:36 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] Created reservations ['0d6e9c4e-6e1e-4afc-8e46-fa8376fa9f86', '3d5bf681-5ba7-41de-a8db-e12136a38974', '6a0135dd-1c61-4a87-8a3d-f4dd124dd3e1', '81641032-c94c-4085-97a2-a662fdca31ba'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:57:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:36 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:57:36 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:36 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.174s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:36 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:57:36 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] Deleted volume successfully. Jul 03 13:57:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-17627923-09ea-47a5-a41f-45b0171b5f41 tempest-TaggedAttachmentsTest-648184428 None] Lock "cinder-2452abeb-e139-4a3e-927e-08240e1c1ccb-delete_volume" released by "delete_volume" :: held 4.023s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:37 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222 1073741824" returned: 0 in 2.131s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:37 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222 Jul 03 13:57:37 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:37 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.424s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:37 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:57:37 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] Deleted volume successfully. Jul 03 13:57:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a5a1a13b-e243-46a7-a8de-a85704f2d827 tempest-ServerRescueNegativeTestJSON-298804928 None] Lock "cinder-9a1533b4-754e-42f3-bd9f-bd35154a5a98-delete_volume" released by "delete_volume" :: held 5.038s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:38 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222" returned: 0 in 1.050s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] <== create_volume: return (3224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:57:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.227s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06668d1-979d-46a9-b388-be1d1ffbec3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe7a42c-a135-4d9d-a3d3-cf60be31c45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:38 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Volume volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222 (43fcaff1-0e66-4f40-8cae-96dc2a7e6222): created successfully Jul 03 13:57:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe7a42c-a135-4d9d-a3d3-cf60be31c45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Flow 'volume_create_manager' (bd510a50-7333-4562-a303-e9f81f8bc7ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:38 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b38c5304-8668-4041-8ffd-dc59b6d37462 tempest-AttachVolumeTestJSON-798433461 None] Created volume successfully. Jul 03 13:57:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-411640a9-00e1-49bf-a881-47d93a60ce5b req-1f5d4eef-654b-487b-873f-4ae45b540e78 tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-411640a9-00e1-49bf-a881-47d93a60ce5b req-1f5d4eef-654b-487b-873f-4ae45b540e78 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:42 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12cbe5e-2e21-4711-b674-9d0feb5fd9db]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-411640a9-00e1-49bf-a881-47d93a60ce5b req-1f5d4eef-654b-487b-873f-4ae45b540e78 tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:42 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222 Jul 03 13:57:42 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:42 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:57:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Flow 'volume_create_manager' (2ed1850c-c321-49e5-a9c2-8c98bd0014f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe0e5773-b72d-4840-a82d-da8417a53e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe0e5773-b72d-4840-a82d-da8417a53e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1504567759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f00bb9-20e0-4b14-adb3-d85aed20f706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd91d48167824d2f963a519a34e2f897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:43Z,use_quota=True,user_id='a9fff1bd805d46ee8c78761cfc2d7f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc8f4a0-bc99-43e3-b315-c5bbc10d0dd9),volume_type_id=7fc8f4a0-bc99-43e3-b315-c5bbc10d0dd9)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e37b8a-52af-4792-bf98-58a420f0691b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e37b8a-52af-4792-bf98-58a420f0691b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413c2a90-7905-4b18-8c9e-1da49adf1c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413c2a90-7905-4b18-8c9e-1da49adf1c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4f00bb9-20e0-4b14-adb3-d85aed20f706', 'volume_name': 'volume-d4f00bb9-20e0-4b14-adb3-d85aed20f706', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8418c316-0095-4c2f-8ec2-9f79c26abf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8418c316-0095-4c2f-8ec2-9f79c26abf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd901dd5-f8e3-4169-8334-c7c30f8dcb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:42 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Volume d4f00bb9-20e0-4b14-adb3-d85aed20f706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4f00bb9-20e0-4b14-adb3-d85aed20f706', 'volume_size': 1} Jul 03 13:57:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:43 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-411640a9-00e1-49bf-a881-47d93a60ce5b req-1f5d4eef-654b-487b-873f-4ae45b540e78 tempest-AttachVolumeTestJSON-798433461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222" returned: 0 in 1.071s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-411640a9-00e1-49bf-a881-47d93a60ce5b req-1f5d4eef-654b-487b-873f-4ae45b540e78 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.108s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.712s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1504567759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f00bb9-20e0-4b14-adb3-d85aed20f706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd91d48167824d2f963a519a34e2f897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:43Z,use_quota=True,user_id='a9fff1bd805d46ee8c78761cfc2d7f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc8f4a0-bc99-43e3-b315-c5bbc10d0dd9),volume_type_id=7fc8f4a0-bc99-43e3-b315-c5bbc10d0dd9)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:57:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Creating volume d4f00bb9-20e0-4b14-adb3-d85aed20f706 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:57:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:57:43 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:57:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d4f00bb9-20e0-4b14-adb3-d85aed20f706 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:43 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d4f00bb9-20e0-4b14-adb3-d85aed20f706 1073741824 Jul 03 13:57:43 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-411640a9-00e1-49bf-a881-47d93a60ce5b req-1f5d4eef-654b-487b-873f-4ae45b540e78 tempest-AttachVolumeTestJSON-798433461 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '629ad080-622c-487e-813b-4c67f710ae11', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:57:43 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-411640a9-00e1-49bf-a881-47d93a60ce5b req-1f5d4eef-654b-487b-873f-4ae45b540e78 tempest-AttachVolumeTestJSON-798433461 None] attachment_update completed successfully. Jul 03 13:57:44 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d4f00bb9-20e0-4b14-adb3-d85aed20f706 1073741824" returned: 0 in 0.985s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d4f00bb9-20e0-4b14-adb3-d85aed20f706 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:44 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d4f00bb9-20e0-4b14-adb3-d85aed20f706 Jul 03 13:57:44 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:45 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d4f00bb9-20e0-4b14-adb3-d85aed20f706" returned: 0 in 0.750s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:57:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd901dd5-f8e3-4169-8334-c7c30f8dcb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f00bb9-20e0-4b14-adb3-d85aed20f706', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20310e89-b557-4fa9-ad6b-cb2ce63749a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:45 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Volume volume-d4f00bb9-20e0-4b14-adb3-d85aed20f706 (d4f00bb9-20e0-4b14-adb3-d85aed20f706): created successfully Jul 03 13:57:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20310e89-b557-4fa9-ad6b-cb2ce63749a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Flow 'volume_create_manager' (2ed1850c-c321-49e5-a9c2-8c98bd0014f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:45 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-43589a6f-547b-4fa0-9a5a-694fd423d16f tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Created volume successfully. Jul 03 13:57:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3d50345f-98a7-467a-ab94-a8a68078d53c tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3d50345f-98a7-467a-ab94-a8a68078d53c tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:46 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3d50345f-98a7-467a-ab94-a8a68078d53c tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:46 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3d50345f-98a7-467a-ab94-a8a68078d53c tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3d50345f-98a7-467a-ab94-a8a68078d53c tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3d50345f-98a7-467a-ab94-a8a68078d53c tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:46 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:57:46 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:47 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3d50345f-98a7-467a-ab94-a8a68078d53c tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.894s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:47 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-3d50345f-98a7-467a-ab94-a8a68078d53c tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:57:47 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-3d50345f-98a7-467a-ab94-a8a68078d53c tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Retype volume completed successfully. Jul 03 13:57:48 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Acquiring lock "cinder-d4f00bb9-20e0-4b14-adb3-d85aed20f706-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:48 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Lock "cinder-d4f00bb9-20e0-4b14-adb3-d85aed20f706-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:48 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Acquiring lock "cinder-quobyte-d4f00bb9-20e0-4b14-adb3-d85aed20f706" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:48 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Lock "cinder-quobyte-d4f00bb9-20e0-4b14-adb3-d85aed20f706" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:48 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[21434937-d8cf-4ceb-b692-7fadda5e880c]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d4f00bb9-20e0-4b14-adb3-d85aed20f706 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:48 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d4f00bb9-20e0-4b14-adb3-d85aed20f706 Jul 03 13:57:48 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:49 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d4f00bb9-20e0-4b14-adb3-d85aed20f706" returned: 0 in 1.104s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d4f00bb9-20e0-4b14-adb3-d85aed20f706 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:49 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d4f00bb9-20e0-4b14-adb3-d85aed20f706 Jul 03 13:57:49 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:50 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d4f00bb9-20e0-4b14-adb3-d85aed20f706" returned: 0 in 0.811s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Lock "cinder-quobyte-d4f00bb9-20e0-4b14-adb3-d85aed20f706" released by "delete_volume" :: held 1.990s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:50 devstack cinder-volume[86805]: WARNING cinder.quota [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:57:50 devstack cinder-volume[86805]: WARNING cinder.quota [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:57:50 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Created reservations ['015900d7-f0cd-417b-bb89-39b3d8b625bd', '0af5bb74-f615-4e6c-b9b3-4a6e7d20f056', '22172f07-fb55-4aa5-86ee-39e7ec83d37d', 'd8154d31-dbf6-4c60-8a81-ebc636e6ecbb'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:57:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:50 devstack sudo[93188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:57:50 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:50 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-ea66995a-e59c-4f05-9503-862317f61ba6 req-a6b39649-d917-4d2c-96b8-3cb331957346 tempest-AttachVolumeTestJSON-798433461 None] Terminate volume connection completed successfully. Jul 03 13:57:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-ea66995a-e59c-4f05-9503-862317f61ba6 req-a6b39649-d917-4d2c-96b8-3cb331957346 tempest-AttachVolumeTestJSON-798433461 None] Deleting attachment d3e7678b-8484-49de-a0b0-0391ce4c62de. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:57:51 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.743s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:51 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:57:51 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Deleted volume successfully. Jul 03 13:57:51 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0fc9f949-601d-4ddb-b7ac-53b0c488eebe tempest-VolumeRetypeWithoutMigrationTest-1957896504 None] Lock "cinder-d4f00bb9-20e0-4b14-adb3-d85aed20f706-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:53 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-34ec9955-5ec5-4f8b-b810-55e1c511a78d req-b3c13527-0b4f-49ca-b653-7185db252797 tempest-AttachVolumeTestJSON-798433461 None] Terminate volume connection completed successfully. Jul 03 13:57:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-34ec9955-5ec5-4f8b-b810-55e1c511a78d req-b3c13527-0b4f-49ca-b653-7185db252797 tempest-AttachVolumeTestJSON-798433461 None] Deleting attachment 629ad080-622c-487e-813b-4c67f710ae11. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:58:01 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=72,cinder:SELECT=68,cinder:INSERT=11,cinder:DELETE=2 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:58:01 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=73,cinder:UPDATE=69,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:58:01 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Flow 'volume_create_manager' (91cd9bd0-7c48-4292-a9a4-95ab44730afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0ac102-a226-4f5c-b15e-1e632747956a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0ac102-a226-4f5c-b15e-1e632747956a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2010202887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0cd969-5c74-4c95-9b73-a0c146ccc16e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95defe07eb9244f693eb9760847be2f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:02Z,use_quota=True,user_id='c6491419398e46fe9582b392d6a00941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de41172-78e3-4b28-991d-632929f631a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de41172-78e3-4b28-991d-632929f631a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6498957e-382d-4e08-8146-db39fce46bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6498957e-382d-4e08-8146-db39fce46bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf0cd969-5c74-4c95-9b73-a0c146ccc16e', 'volume_name': 'volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732edabd-84b1-4451-951d-5c34706a3bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732edabd-84b1-4451-951d-5c34706a3bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e23523e-333e-4363-98bd-9dbb18f1072a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:02 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Volume bf0cd969-5c74-4c95-9b73-a0c146ccc16e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e', 'volume_size': 1} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2010202887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0cd969-5c74-4c95-9b73-a0c146ccc16e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95defe07eb9244f693eb9760847be2f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:02Z,use_quota=True,user_id='c6491419398e46fe9582b392d6a00941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Creating volume bf0cd969-5c74-4c95-9b73-a0c146ccc16e {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:58:02 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:58:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:02 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e 1073741824 Jul 03 13:58:02 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:03 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e 1073741824" returned: 0 in 1.394s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:03 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e Jul 03 13:58:03 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:04 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e" returned: 0 in 0.817s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] <== create_volume: return (2302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:58:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.304s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e23523e-333e-4363-98bd-9dbb18f1072a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6982a8c7-24a8-4a90-bd5b-57218384b4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:04 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Volume volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e (bf0cd969-5c74-4c95-9b73-a0c146ccc16e): created successfully Jul 03 13:58:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6982a8c7-24a8-4a90-bd5b-57218384b4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Flow 'volume_create_manager' (91cd9bd0-7c48-4292-a9a4-95ab44730afa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:04 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-d4c6cca8-6e23-4462-998e-2c2d8a237d89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Created volume successfully. Jul 03 13:58:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Creating offline snapshot 3129b22a-cb78-4051-a9f0-90df31bf8173 of volume bf0cd969-5c74-4c95-9b73-a0c146ccc16e {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:58:05 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb5708e-8d19-42b2-b2eb-164b11c0fa18]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:05 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e Jul 03 13:58:05 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:06 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e" returned: 0 in 1.122s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:06 devstack sudo[93329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173 1G Jul 03 13:58:06 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "cinder-43fcaff1-0e66-4f40-8cae-96dc2a7e6222-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] Lock "cinder-43fcaff1-0e66-4f40-8cae-96dc2a7e6222-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "cinder-quobyte-43fcaff1-0e66-4f40-8cae-96dc2a7e6222" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] Lock "cinder-quobyte-43fcaff1-0e66-4f40-8cae-96dc2a7e6222" acquired by "delete_volume" :: waited 0.033s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:07 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173 1G" returned: 0 in 1.108s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:07 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[509f6685-fb90-43bf-be5b-62e0e2b5b9cd]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:07 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173 Jul 03 13:58:07 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:07 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222 Jul 03 13:58:07 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:08 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173" returned: 0 in 0.916s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:08 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173 is being set with open permissions: ugo+rw Jul 03 13:58:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:08 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173 Jul 03 13:58:08 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:08 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222" returned: 0 in 0.977s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:08 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222 Jul 03 13:58:08 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:09 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43fcaff1-0e66-4f40-8cae-96dc2a7e6222" returned: 0 in 0.704s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] Lock "cinder-quobyte-43fcaff1-0e66-4f40-8cae-96dc2a7e6222" released by "delete_volume" :: held 1.747s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:09 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] Created reservations ['4041461d-c74f-4797-9997-b889f2296d15', '5bb1b548-3415-4ed6-b47e-3ecf3e986d29', '9536d2ba-4db9-45eb-9621-899a882a5d94', 'ab766481-122f-47df-a7a0-27519ec4379d'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:09 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173" returned: 0 in 0.974s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:09 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:58:09 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:09 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.info Jul 03 13:58:09 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "cinder-090efbe4-da9b-46e1-84a7-f36d367c0589-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] Lock "cinder-090efbe4-da9b-46e1-84a7-f36d367c0589-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "cinder-quobyte-090efbe4-da9b-46e1-84a7-f36d367c0589" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] Lock "cinder-quobyte-090efbe4-da9b-46e1-84a7-f36d367c0589" acquired by "delete_volume" :: waited 0.037s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:10 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f46d201-308c-4022-b602-00a7fd7b93fc]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-090efbe4-da9b-46e1-84a7-f36d367c0589 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:10 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-090efbe4-da9b-46e1-84a7-f36d367c0589 Jul 03 13:58:10 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:10 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.141s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:10 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:10 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] Deleted volume successfully. Jul 03 13:58:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-21333f35-4ab2-44d0-b006-c636ecf218c0 tempest-AttachVolumeTestJSON-798433461 None] Lock "cinder-43fcaff1-0e66-4f40-8cae-96dc2a7e6222-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:10 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.info" returned: 0 in 1.235s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:10 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.info is being set with open permissions: ugo+rw Jul 03 13:58:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:11 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.info Jul 03 13:58:11 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:11 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-090efbe4-da9b-46e1-84a7-f36d367c0589" returned: 0 in 1.254s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-090efbe4-da9b-46e1-84a7-f36d367c0589 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:11 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-090efbe4-da9b-46e1-84a7-f36d367c0589 Jul 03 13:58:11 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:11 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.info" returned: 0 in 0.771s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.306s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:11 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-0ef9de6c-f078-400a-9197-4d0c623ad1f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Create snapshot completed successfully Jul 03 13:58:12 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-090efbe4-da9b-46e1-84a7-f36d367c0589" returned: 0 in 0.943s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] Lock "cinder-quobyte-090efbe4-da9b-46e1-84a7-f36d367c0589" released by "delete_volume" :: held 2.261s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:12 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] Created reservations ['256cfdc4-0e2d-4a2e-b647-5d6d26db4eb5', '1c15109c-a6ff-42ad-9a60-3d9605e237ba', 'fdb15417-e3af-45f5-8e62-aeca737b0baf', 'c13a4403-c136-4981-9a1e-726e4d755d12'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:12 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:58:12 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Acquiring lock "cinder-3129b22a-cb78-4051-a9f0-90df31bf8173-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "cinder-3129b22a-cb78-4051-a9f0-90df31bf8173-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Acquiring lock "cinder-quobyte-bf0cd969-5c74-4c95-9b73-a0c146ccc16e" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "cinder-quobyte-bf0cd969-5c74-4c95-9b73-a0c146ccc16e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Acquiring lock "cinder-quobyte-3129b22a-cb78-4051-a9f0-90df31bf8173" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "cinder-quobyte-3129b22a-cb78-4051-a9f0-90df31bf8173" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Deleting offline snapshot 3129b22a-cb78-4051-a9f0-90df31bf8173 of volume bf0cd969-5c74-4c95-9b73-a0c146ccc16e {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] snapshot_file for this snap is: volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f860bd8-77bb-4359-8372-7d86e2e51e81]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:13 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.027s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:13 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] Deleted volume successfully. Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0621efdc-05fe-4124-8cef-e93838dd51a0 tempest-AttachVolumeTestJSON-798433461 None] Lock "cinder-090efbe4-da9b-46e1-84a7-f36d367c0589-delete_volume" released by "delete_volume" :: held 3.649s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "cinder-de41faf3-7301-4074-b2e0-afc4bdb97d1a-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] Lock "cinder-de41faf3-7301-4074-b2e0-afc4bdb97d1a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "cinder-quobyte-de41faf3-7301-4074-b2e0-afc4bdb97d1a" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] Lock "cinder-quobyte-de41faf3-7301-4074-b2e0-afc4bdb97d1a" acquired by "delete_volume" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:13 devstack sudo[93379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173 Jul 03 13:58:13 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d30185-4fe8-4cff-a14e-bb2c6f8ffa0a]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:14 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a Jul 03 13:58:14 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:14 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173" returned: 0 in 1.098s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:58:14 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05e2cf5-aedb-433f-bfae-f13478b0be2d]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:14 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e Jul 03 13:58:14 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:14 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a" returned: 0 in 1.066s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:14 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a Jul 03 13:58:14 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:15 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:15 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e" returned: 0 in 1.101s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-de41faf3-7301-4074-b2e0-afc4bdb97d1a" returned: 0 in 0.952s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:15 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173 Jul 03 13:58:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] Lock "cinder-quobyte-de41faf3-7301-4074-b2e0-afc4bdb97d1a" released by "delete_volume" :: held 2.070s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:15 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:15 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] Created reservations ['b46a0a31-62ae-4805-8a55-07772e59f9bb', '7d5ff0f6-9b91-4bce-a352-4b5d0ce962a8', '16ddf6d0-cc6f-4f07-bd0e-ef7c20fb1695', 'cc90f6e4-1218-405b-9e07-5ee3307c2cb5'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:16 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:58:16 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:16 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173" returned: 0 in 0.785s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:16 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173 Jul 03 13:58:16 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:16 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.690s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:16 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:16 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] Deleted volume successfully. Jul 03 13:58:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b26ce2a1-0627-4181-bc72-f73ddfe7a3b4 tempest-AttachVolumeTestJSON-798433461 None] Lock "cinder-de41faf3-7301-4074-b2e0-afc4bdb97d1a-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:17 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e.3129b22a-cb78-4051-a9f0-90df31bf8173" returned: 0 in 0.849s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "cinder-quobyte-3129b22a-cb78-4051-a9f0-90df31bf8173" released by "_delete_snapshot" :: held 3.985s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "cinder-quobyte-bf0cd969-5c74-4c95-9b73-a0c146ccc16e" released by "delete_snapshot" :: held 4.009s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:17 devstack cinder-volume[86805]: WARNING cinder.quota [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:58:17 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Created reservations ['73cba48e-745c-4952-a96e-9400b6525e99', '2470933b-e38d-4a69-961e-e06551c8c179', '5e71f8ec-bf80-42df-8ef2-31bce913aa1d', '0b667b10-b09c-47aa-9f71-df0c8eed73a7'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:17 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Delete snapshot completed successfully. Jul 03 13:58:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-da1e69fb-7a64-4dc7-850d-f2bd33f68fe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "cinder-3129b22a-cb78-4051-a9f0-90df31bf8173-delete_snapshot" released by "delete_snapshot" :: held 4.178s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Acquiring lock "cinder-bf0cd969-5c74-4c95-9b73-a0c146ccc16e-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "cinder-bf0cd969-5c74-4c95-9b73-a0c146ccc16e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Acquiring lock "cinder-quobyte-bf0cd969-5c74-4c95-9b73-a0c146ccc16e" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "cinder-quobyte-bf0cd969-5c74-4c95-9b73-a0c146ccc16e" acquired by "delete_volume" :: waited 0.026s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:18 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a62252a-279b-43b4-8a34-8b691062a6ec]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:18 devstack sudo[93415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e Jul 03 13:58:18 devstack sudo[93415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:19 devstack sudo[93415]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e" returned: 0 in 0.912s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:19 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e Jul 03 13:58:19 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:19 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bf0cd969-5c74-4c95-9b73-a0c146ccc16e" returned: 0 in 0.810s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "cinder-quobyte-bf0cd969-5c74-4c95-9b73-a0c146ccc16e" released by "delete_volume" :: held 1.820s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:19 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Created reservations ['3089d6e7-0edb-4b28-8c8a-179b63ddc22b', '3b85bc6d-2498-4e7f-bcc5-8d3b3a4caf79', '13cc6942-6753-4e7e-b181-7f918866633e', '07d1786f-9be1-4d66-b890-f36e6dd1b5af'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:20 devstack sudo[93439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:58:20 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:21 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.004s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:21 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:21 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Deleted volume successfully. Jul 03 13:58:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-427060e1-0ca9-4e73-8b64-9493c425ffef tempest-VolumeSnapshotQuotasNegativeTestJSON-1564717110 None] Lock "cinder-bf0cd969-5c74-4c95-9b73-a0c146ccc16e-delete_volume" released by "delete_volume" :: held 3.166s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Flow 'volume_create_manager' (3c7f5a08-d3df-4bf2-b71f-78abac48405d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f478713-5491-405f-8dc9-f9782dfed695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f478713-5491-405f-8dc9-f9782dfed695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-163613511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237b7792-fac4-49fd-9255-738912b1d30e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b77cfbd5474157bed9f92b8b16645f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:27Z,use_quota=True,user_id='4d91e09c47bf4d8c8bc8fd17e1ba1059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b8d718-5ae1-4871-8e93-91d4123c8ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b8d718-5ae1-4871-8e93-91d4123c8ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86908c1f-c1a1-4107-8346-6dd4adf8d8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86908c1f-c1a1-4107-8346-6dd4adf8d8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '237b7792-fac4-49fd-9255-738912b1d30e', 'volume_name': 'volume-237b7792-fac4-49fd-9255-738912b1d30e', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ad0473-b900-4559-885e-d35e58c61bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ad0473-b900-4559-885e-d35e58c61bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd68e5f-19f6-4759-9903-19d4bb45597a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:26 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Volume 237b7792-fac4-49fd-9255-738912b1d30e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-237b7792-fac4-49fd-9255-738912b1d30e', 'volume_size': 1} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-163613511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237b7792-fac4-49fd-9255-738912b1d30e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b77cfbd5474157bed9f92b8b16645f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:27Z,use_quota=True,user_id='4d91e09c47bf4d8c8bc8fd17e1ba1059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Creating volume 237b7792-fac4-49fd-9255-738912b1d30e {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:58:26 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:58:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-237b7792-fac4-49fd-9255-738912b1d30e 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:27 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-237b7792-fac4-49fd-9255-738912b1d30e 1073741824 Jul 03 13:58:27 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:28 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-237b7792-fac4-49fd-9255-738912b1d30e 1073741824" returned: 0 in 1.394s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-237b7792-fac4-49fd-9255-738912b1d30e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:28 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-237b7792-fac4-49fd-9255-738912b1d30e Jul 03 13:58:28 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:29 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-237b7792-fac4-49fd-9255-738912b1d30e" returned: 0 in 1.380s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] <== create_volume: return (2931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:58:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.934s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd68e5f-19f6-4759-9903-19d4bb45597a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-237b7792-fac4-49fd-9255-738912b1d30e', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab41d5d-180b-46eb-a29e-01ab66582b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:29 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Volume volume-237b7792-fac4-49fd-9255-738912b1d30e (237b7792-fac4-49fd-9255-738912b1d30e): created successfully Jul 03 13:58:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab41d5d-180b-46eb-a29e-01ab66582b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Flow 'volume_create_manager' (3c7f5a08-d3df-4bf2-b71f-78abac48405d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:30 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-70c4e608-646d-427f-a8d9-a8a179b09ba4 tempest-VolumesMetadataTest-573335101 None] Created volume successfully. Jul 03 13:58:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] Acquiring lock "cinder-237b7792-fac4-49fd-9255-738912b1d30e-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] Lock "cinder-237b7792-fac4-49fd-9255-738912b1d30e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] Acquiring lock "cinder-quobyte-237b7792-fac4-49fd-9255-738912b1d30e" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] Lock "cinder-quobyte-237b7792-fac4-49fd-9255-738912b1d30e" acquired by "delete_volume" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:32 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d7681e-c07a-4616-bd79-4eca1aa97d71]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-237b7792-fac4-49fd-9255-738912b1d30e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:32 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-237b7792-fac4-49fd-9255-738912b1d30e Jul 03 13:58:32 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:33 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-237b7792-fac4-49fd-9255-738912b1d30e" returned: 0 in 1.115s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-237b7792-fac4-49fd-9255-738912b1d30e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:33 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-237b7792-fac4-49fd-9255-738912b1d30e Jul 03 13:58:33 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:34 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-237b7792-fac4-49fd-9255-738912b1d30e" returned: 0 in 1.021s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] Lock "cinder-quobyte-237b7792-fac4-49fd-9255-738912b1d30e" released by "delete_volume" :: held 2.214s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:34 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] Created reservations ['c4174838-e34a-406b-873d-fc081b0950b9', 'ed265fcd-c3aa-4396-b9fd-50b276028023', 'f9e125fc-43dd-488a-9aae-f1d101bead0a', '6bf37081-af53-4abc-b877-b612c1596b41'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:34 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:58:34 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:35 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.961s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:35 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:35 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] Deleted volume successfully. Jul 03 13:58:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ed06dc14-15a6-446e-b3fd-e69d50b8d1e4 tempest-VolumesMetadataTest-573335101 None] Lock "cinder-237b7792-fac4-49fd-9255-738912b1d30e-delete_volume" released by "delete_volume" :: held 3.506s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:36 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-83e10dc6-07f1-4ca6-be67-f91d46f5616d tempest-GroupsV320Test-1824073518 None] Group tempest-GroupsV320Test-Group-442882098: creating Jul 03 13:58:36 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-83e10dc6-07f1-4ca6-be67-f91d46f5616d tempest-GroupsV320Test-1824073518 None] Group tempest-GroupsV320Test-Group-442882098: created successfully Jul 03 13:58:36 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-83e10dc6-07f1-4ca6-be67-f91d46f5616d tempest-GroupsV320Test-1824073518 None] Create group completed successfully. Jul 03 13:58:39 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-8e058d38-2bbb-4765-9fb8-97d0da169c84 tempest-GroupsV320Test-1824073518 None] Created reservations ['aa327881-44af-4498-aa7f-02b90201ce51'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8e058d38-2bbb-4765-9fb8-97d0da169c84 tempest-GroupsV320Test-1824073518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8e058d38-2bbb-4765-9fb8-97d0da169c84 tempest-GroupsV320Test-1824073518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8e058d38-2bbb-4765-9fb8-97d0da169c84 tempest-GroupsV320Test-1824073518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8e058d38-2bbb-4765-9fb8-97d0da169c84 tempest-GroupsV320Test-1824073518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8e058d38-2bbb-4765-9fb8-97d0da169c84 tempest-GroupsV320Test-1824073518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8e058d38-2bbb-4765-9fb8-97d0da169c84 tempest-GroupsV320Test-1824073518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:39 devstack sudo[93634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:58:39 devstack sudo[93634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:40 devstack sudo[93634]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8e058d38-2bbb-4765-9fb8-97d0da169c84 tempest-GroupsV320Test-1824073518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.188s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:40 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-8e058d38-2bbb-4765-9fb8-97d0da169c84 tempest-GroupsV320Test-1824073518 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:40 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-8e058d38-2bbb-4765-9fb8-97d0da169c84 tempest-GroupsV320Test-1824073518 None] Delete group completed successfully. Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Flow 'volume_create_manager' (c1dab4be-661e-4024-a8cf-fd84bd157975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b3babc-f976-407c-b3c5-c28a9b336c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b3babc-f976-407c-b3c5-c28a9b336c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1344177843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61985187-2e61-46eb-8265-54f9d5e005b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a97826f3be845e989cac6cc5c6efcb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:42Z,use_quota=True,user_id='9d1a4d72d593463aa4fe3c68673c20dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c6ec0d-12bd-4a1f-a7e2-97fbc99d19df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c6ec0d-12bd-4a1f-a7e2-97fbc99d19df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125ebdf3-47b5-4518-bbf3-84efc4c3db3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125ebdf3-47b5-4518-bbf3-84efc4c3db3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61985187-2e61-46eb-8265-54f9d5e005b8', 'volume_name': 'volume-61985187-2e61-46eb-8265-54f9d5e005b8', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b311be2c-2d99-47ce-ac10-c29842500c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b311be2c-2d99-47ce-ac10-c29842500c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db13ddd-e826-449b-870d-119be23c8294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:42 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Volume 61985187-2e61-46eb-8265-54f9d5e005b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61985187-2e61-46eb-8265-54f9d5e005b8', 'volume_size': 1} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1344177843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61985187-2e61-46eb-8265-54f9d5e005b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a97826f3be845e989cac6cc5c6efcb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:42Z,use_quota=True,user_id='9d1a4d72d593463aa4fe3c68673c20dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Creating volume 61985187-2e61-46eb-8265-54f9d5e005b8 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:58:42 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:58:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-61985187-2e61-46eb-8265-54f9d5e005b8 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:42 devstack sudo[93669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-61985187-2e61-46eb-8265-54f9d5e005b8 1073741824 Jul 03 13:58:42 devstack sudo[93669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:43 devstack sudo[93669]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-61985187-2e61-46eb-8265-54f9d5e005b8 1073741824" returned: 0 in 1.208s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-61985187-2e61-46eb-8265-54f9d5e005b8 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:43 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-61985187-2e61-46eb-8265-54f9d5e005b8 Jul 03 13:58:43 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-61985187-2e61-46eb-8265-54f9d5e005b8" returned: 0 in 0.804s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:58:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:44 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:44 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db13ddd-e826-449b-870d-119be23c8294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61985187-2e61-46eb-8265-54f9d5e005b8', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:44 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed5703a-bc70-428c-9d6d-4cc9cd07022a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:44 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Volume volume-61985187-2e61-46eb-8265-54f9d5e005b8 (61985187-2e61-46eb-8265-54f9d5e005b8): created successfully Jul 03 13:58:44 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed5703a-bc70-428c-9d6d-4cc9cd07022a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:44 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Flow 'volume_create_manager' (c1dab4be-661e-4024-a8cf-fd84bd157975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:44 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b7755049-a4e9-465c-8ff6-9186216d5182 tempest-VolumesTransfersTest-1040376728 None] Created volume successfully. Jul 03 13:58:46 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-9efe8816-0683-4c03-8d7b-e94a9d9d227a tempest-VolumesTransfersTest-768285862 None] Transfer volume completed successfully. Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] Acquiring lock "cinder-61985187-2e61-46eb-8265-54f9d5e005b8-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Flow 'volume_create_manager' (6428710d-e86d-4543-85cd-09f46e9486df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22eddd62-7b3d-4e64-9e94-c90d005c83c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22eddd62-7b3d-4e64-9e94-c90d005c83c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1964627436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff014d55-5b9e-4bb8-9dc6-3899d4b96379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f1c4f4697a459fa907e0c473c8037e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:48Z,use_quota=True,user_id='3b1c1d0d9766441c80a1421324d9dc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9452d33e-58b0-4681-b982-c58405256d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9452d33e-58b0-4681-b982-c58405256d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e6411b-d3f1-4d38-be10-ad1753531d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e6411b-d3f1-4d38-be10-ad1753531d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff014d55-5b9e-4bb8-9dc6-3899d4b96379', 'volume_name': 'volume-ff014d55-5b9e-4bb8-9dc6-3899d4b96379', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c91e6d-d963-4936-ab44-7eddf8b1741d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c91e6d-d963-4936-ab44-7eddf8b1741d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99198023-ed4d-479b-8e2a-ed15c131ef1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:47 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Volume ff014d55-5b9e-4bb8-9dc6-3899d4b96379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff014d55-5b9e-4bb8-9dc6-3899d4b96379', 'volume_size': 1} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1964627436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff014d55-5b9e-4bb8-9dc6-3899d4b96379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f1c4f4697a459fa907e0c473c8037e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:48Z,use_quota=True,user_id='3b1c1d0d9766441c80a1421324d9dc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Creating volume ff014d55-5b9e-4bb8-9dc6-3899d4b96379 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:58:47 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ff014d55-5b9e-4bb8-9dc6-3899d4b96379 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] Lock "cinder-61985187-2e61-46eb-8265-54f9d5e005b8-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:47 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ff014d55-5b9e-4bb8-9dc6-3899d4b96379 1073741824 Jul 03 13:58:47 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] Acquiring lock "cinder-quobyte-61985187-2e61-46eb-8265-54f9d5e005b8" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] Lock "cinder-quobyte-61985187-2e61-46eb-8265-54f9d5e005b8" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e093af-6453-424c-8036-74d04f45f4fc]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-61985187-2e61-46eb-8265-54f9d5e005b8 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:48 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-61985187-2e61-46eb-8265-54f9d5e005b8 Jul 03 13:58:48 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:48 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-61985187-2e61-46eb-8265-54f9d5e005b8" returned: 0 in 0.813s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:48 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-61985187-2e61-46eb-8265-54f9d5e005b8 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ff014d55-5b9e-4bb8-9dc6-3899d4b96379 1073741824" returned: 0 in 0.927s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:48 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-61985187-2e61-46eb-8265-54f9d5e005b8 Jul 03 13:58:48 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ff014d55-5b9e-4bb8-9dc6-3899d4b96379 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:48 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ff014d55-5b9e-4bb8-9dc6-3899d4b96379 Jul 03 13:58:48 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:49 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-61985187-2e61-46eb-8265-54f9d5e005b8" returned: 0 in 0.800s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:49 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] Lock "cinder-quobyte-61985187-2e61-46eb-8265-54f9d5e005b8" released by "delete_volume" :: held 1.666s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:49 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] Created reservations ['e2bec063-1aed-467e-b638-7d58327a907e', 'ac16e13d-ed0d-4ac3-a9b0-9699c7b67944', '89b76c7b-fc87-40f5-a437-5c524b3110ae', '6a5093fa-a21d-4bf7-9d00-a9b5bf9237ba'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:49 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ff014d55-5b9e-4bb8-9dc6-3899d4b96379" returned: 0 in 0.846s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:58:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99198023-ed4d-479b-8e2a-ed15c131ef1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff014d55-5b9e-4bb8-9dc6-3899d4b96379', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258c8aee-d006-4931-8ae0-d1afdb7d15a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:49 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Volume volume-ff014d55-5b9e-4bb8-9dc6-3899d4b96379 (ff014d55-5b9e-4bb8-9dc6-3899d4b96379): created successfully Jul 03 13:58:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258c8aee-d006-4931-8ae0-d1afdb7d15a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Flow 'volume_create_manager' (6428710d-e86d-4543-85cd-09f46e9486df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:49 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4a782d83-00ca-462b-b79a-addd2334ba25 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Created volume successfully. Jul 03 13:58:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:49 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:58:49 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:50 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.082s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:50 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:50 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] Deleted volume successfully. Jul 03 13:58:50 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:58:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Flow 'volume_create_manager' (5a525e27-15eb-4548-bc85-b5668b32f5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ebee1d-b43f-410a-9a24-afeaed5597d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-caa75275-be77-4f6f-bf5f-6814178abcc2 tempest-VolumesTransfersTest-1988949089 None] Lock "cinder-61985187-2e61-46eb-8265-54f9d5e005b8-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ebee1d-b43f-410a-9a24-afeaed5597d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1298423039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a4a63e-c957-4d89-9d6d-8033259ea518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a97826f3be845e989cac6cc5c6efcb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:51Z,use_quota=True,user_id='9d1a4d72d593463aa4fe3c68673c20dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c7e01f-4091-481e-9772-7eff8c36ff9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c7e01f-4091-481e-9772-7eff8c36ff9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aca657c-3579-4d99-a0ff-d78eae139883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aca657c-3579-4d99-a0ff-d78eae139883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a4a63e-c957-4d89-9d6d-8033259ea518', 'volume_name': 'volume-65a4a63e-c957-4d89-9d6d-8033259ea518', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3151076f-b8c2-4030-bd1c-a665f36b1e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3151076f-b8c2-4030-bd1c-a665f36b1e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c5ab8b-dc6b-49c3-8408-59c88fbd65bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:51 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Volume 65a4a63e-c957-4d89-9d6d-8033259ea518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a4a63e-c957-4d89-9d6d-8033259ea518', 'volume_size': 1} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1298423039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a4a63e-c957-4d89-9d6d-8033259ea518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a97826f3be845e989cac6cc5c6efcb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:51Z,use_quota=True,user_id='9d1a4d72d593463aa4fe3c68673c20dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Creating volume 65a4a63e-c957-4d89-9d6d-8033259ea518 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:58:51 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-65a4a63e-c957-4d89-9d6d-8033259ea518 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:51 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-65a4a63e-c957-4d89-9d6d-8033259ea518 1073741824 Jul 03 13:58:51 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Acquiring lock "cinder-ff014d55-5b9e-4bb8-9dc6-3899d4b96379-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Lock "cinder-ff014d55-5b9e-4bb8-9dc6-3899d4b96379-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Acquiring lock "cinder-quobyte-ff014d55-5b9e-4bb8-9dc6-3899d4b96379" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Lock "cinder-quobyte-ff014d55-5b9e-4bb8-9dc6-3899d4b96379" acquired by "delete_volume" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[296821c7-5354-4e1b-ae2e-0f63d8c08edd]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ff014d55-5b9e-4bb8-9dc6-3899d4b96379 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:51 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ff014d55-5b9e-4bb8-9dc6-3899d4b96379 Jul 03 13:58:51 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:52 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-65a4a63e-c957-4d89-9d6d-8033259ea518 1073741824" returned: 0 in 1.064s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-65a4a63e-c957-4d89-9d6d-8033259ea518 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:52 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-65a4a63e-c957-4d89-9d6d-8033259ea518 Jul 03 13:58:52 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:52 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ff014d55-5b9e-4bb8-9dc6-3899d4b96379" returned: 0 in 0.828s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ff014d55-5b9e-4bb8-9dc6-3899d4b96379 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:52 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ff014d55-5b9e-4bb8-9dc6-3899d4b96379 Jul 03 13:58:52 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:52 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-65a4a63e-c957-4d89-9d6d-8033259ea518" returned: 0 in 0.764s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:58:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c5ab8b-dc6b-49c3-8408-59c88fbd65bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a4a63e-c957-4d89-9d6d-8033259ea518', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5532a5-de08-4bd7-90c5-9bb4cc871035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:53 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Volume volume-65a4a63e-c957-4d89-9d6d-8033259ea518 (65a4a63e-c957-4d89-9d6d-8033259ea518): created successfully Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5532a5-de08-4bd7-90c5-9bb4cc871035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Flow 'volume_create_manager' (5a525e27-15eb-4548-bc85-b5668b32f5d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:53 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-c0da2f9d-ead3-45fc-a05a-d71e5600f2df tempest-VolumesTransfersTest-1040376728 None] Created volume successfully. Jul 03 13:58:53 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ff014d55-5b9e-4bb8-9dc6-3899d4b96379" returned: 0 in 0.906s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Lock "cinder-quobyte-ff014d55-5b9e-4bb8-9dc6-3899d4b96379" released by "delete_volume" :: held 1.801s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Created reservations ['72d54897-459d-426e-a6c9-1c296b0b9690', 'fc795662-21ad-4066-b2a0-569b71edba2c', '90461c91-dd4e-46a6-b4b4-570af439372b', 'af06c806-015d-42b1-826a-d1a4209c80c3'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:53 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:58:53 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Flow 'volume_create_manager' (c04e2145-91d4-4077-8706-2da67fb0e03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11cea03b-2804-4a47-848a-01876e5dffd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11cea03b-2804-4a47-848a-01876e5dffd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2139433432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6dec1e-b554-4b14-a2de-3fca7dfe052c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f7c64c2f1244e0b299bff38cb5ce26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:53Z,use_quota=True,user_id='b0b7b30a755e4d18bc8b60fcc3a0b35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af626072-080e-4c08-b36e-9c7b6b49403e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af626072-080e-4c08-b36e-9c7b6b49403e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70370643-fd1c-472c-ade1-e6b7f0bf132b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70370643-fd1c-472c-ade1-e6b7f0bf132b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db6dec1e-b554-4b14-a2de-3fca7dfe052c', 'volume_name': 'volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882e6f7e-9171-4355-b20f-1db95f43a041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882e6f7e-9171-4355-b20f-1db95f43a041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452b5415-ee59-48c7-8f58-c1bdce0ec815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:53 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Volume db6dec1e-b554-4b14-a2de-3fca7dfe052c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c', 'volume_size': 1} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2139433432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6dec1e-b554-4b14-a2de-3fca7dfe052c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f7c64c2f1244e0b299bff38cb5ce26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:53Z,use_quota=True,user_id='b0b7b30a755e4d18bc8b60fcc3a0b35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Creating volume db6dec1e-b554-4b14-a2de-3fca7dfe052c {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:58:53 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:58:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:53 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c 1073741824 Jul 03 13:58:53 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:54 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] Acquiring lock "cinder-65a4a63e-c957-4d89-9d6d-8033259ea518-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:54 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] Lock "cinder-65a4a63e-c957-4d89-9d6d-8033259ea518-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:54 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.845s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:54 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:54 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Deleted volume successfully. Jul 03 13:58:54 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6de70cc1-9696-4740-b8b1-ab32099ffd66 tempest-VolumeQuotasNegativeTestJSON-582493668 None] Lock "cinder-ff014d55-5b9e-4bb8-9dc6-3899d4b96379-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:54 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] Acquiring lock "cinder-quobyte-65a4a63e-c957-4d89-9d6d-8033259ea518" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:54 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] Lock "cinder-quobyte-65a4a63e-c957-4d89-9d6d-8033259ea518" acquired by "delete_volume" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:54 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f392ff15-1c17-4127-81b4-eece749ea73b]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-65a4a63e-c957-4d89-9d6d-8033259ea518 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:54 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-65a4a63e-c957-4d89-9d6d-8033259ea518 Jul 03 13:58:54 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:54 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c 1073741824" returned: 0 in 1.052s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:54 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c Jul 03 13:58:54 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:55 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-65a4a63e-c957-4d89-9d6d-8033259ea518" returned: 0 in 0.856s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-65a4a63e-c957-4d89-9d6d-8033259ea518 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:55 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-65a4a63e-c957-4d89-9d6d-8033259ea518 Jul 03 13:58:55 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:55 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c" returned: 0 in 0.758s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:58:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452b5415-ee59-48c7-8f58-c1bdce0ec815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c96381-de4c-4094-986b-eaa739294047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:55 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Volume volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c (db6dec1e-b554-4b14-a2de-3fca7dfe052c): created successfully Jul 03 13:58:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c96381-de4c-4094-986b-eaa739294047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Flow 'volume_create_manager' (c04e2145-91d4-4077-8706-2da67fb0e03e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:55 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-24f20f1a-d969-4215-b93f-bbab248e3adc tempest-AttachVolumeNegativeTest-1388742330 None] Created volume successfully. Jul 03 13:58:56 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-65a4a63e-c957-4d89-9d6d-8033259ea518" returned: 0 in 0.776s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] Lock "cinder-quobyte-65a4a63e-c957-4d89-9d6d-8033259ea518" released by "delete_volume" :: held 1.685s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:56 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] Created reservations ['2e65944f-220f-46b2-9dc2-cd29f9c57178', '171a5f0a-14da-4af3-994f-2e63eb96260c', 'f0079735-be1f-4d83-a787-f15e5477cb98', '83f26ae0-ebba-4bfa-b4ee-e69ce7a24d7b'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:56 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:58:56 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:56 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.765s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:56 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:56 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] Deleted volume successfully. Jul 03 13:58:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6f7bbfa0-ac22-468f-a22d-792f054e6245 tempest-VolumesTransfersTest-1988949089 None] Lock "cinder-65a4a63e-c957-4d89-9d6d-8033259ea518-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:58:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:58 devstack sudo[93834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:58:58 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:59 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.811s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-7869125b-0a1e-4432-8619-716e2dd308e0 req-d2f4b9fc-86f3-4556-a39b-bcd805d3aba0 tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-7869125b-0a1e-4432-8619-716e2dd308e0 req-d2f4b9fc-86f3-4556-a39b-bcd805d3aba0 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:59 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5c260a-899c-4442-9a26-0644a2745d08]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-7869125b-0a1e-4432-8619-716e2dd308e0 req-d2f4b9fc-86f3-4556-a39b-bcd805d3aba0 tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:00 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c Jul 03 13:59:00 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Flow 'volume_create_manager' (01151536-fbee-4c8d-9c1e-3406e44fd756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b8fa5d-c9ee-4495-9f9c-81946b3d74d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b8fa5d-c9ee-4495-9f9c-81946b3d74d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-619587300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9c78f0-2143-4625-b510-0a8aefe07736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591bf0766dab454aa0ade4c0713e781c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:00Z,use_quota=True,user_id='29e00962ea554f2da46a517129b660e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70531258-d613-4370-be9f-889cd7b3f539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70531258-d613-4370-be9f-889cd7b3f539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e85623e-156d-48d9-8771-4bfba7a50daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e85623e-156d-48d9-8771-4bfba7a50daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b9c78f0-2143-4625-b510-0a8aefe07736', 'volume_name': 'volume-5b9c78f0-2143-4625-b510-0a8aefe07736', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95ed68b-13c1-4369-aa91-afde24233039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95ed68b-13c1-4369-aa91-afde24233039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf6fddc-db6e-480c-9394-1684b1f8c856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:00 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Volume 5b9c78f0-2143-4625-b510-0a8aefe07736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b9c78f0-2143-4625-b510-0a8aefe07736', 'volume_size': 1} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:00 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-7869125b-0a1e-4432-8619-716e2dd308e0 req-d2f4b9fc-86f3-4556-a39b-bcd805d3aba0 tempest-AttachVolumeNegativeTest-1388742330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c" returned: 0 in 0.880s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-7869125b-0a1e-4432-8619-716e2dd308e0 req-d2f4b9fc-86f3-4556-a39b-bcd805d3aba0 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.907s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.447s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-619587300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9c78f0-2143-4625-b510-0a8aefe07736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591bf0766dab454aa0ade4c0713e781c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:00Z,use_quota=True,user_id='29e00962ea554f2da46a517129b660e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Creating volume 5b9c78f0-2143-4625-b510-0a8aefe07736 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:59:00 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b9c78f0-2143-4625-b510-0a8aefe07736 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:00 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b9c78f0-2143-4625-b510-0a8aefe07736 1073741824 Jul 03 13:59:00 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-7869125b-0a1e-4432-8619-716e2dd308e0 req-d2f4b9fc-86f3-4556-a39b-bcd805d3aba0 tempest-AttachVolumeNegativeTest-1388742330 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3a22216-1b07-4d61-a4fa-d4edab6db3f3', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:59:00 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-7869125b-0a1e-4432-8619-716e2dd308e0 req-d2f4b9fc-86f3-4556-a39b-bcd805d3aba0 tempest-AttachVolumeNegativeTest-1388742330 None] attachment_update completed successfully. Jul 03 13:59:01 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b9c78f0-2143-4625-b510-0a8aefe07736 1073741824" returned: 0 in 1.129s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b9c78f0-2143-4625-b510-0a8aefe07736 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:01 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b9c78f0-2143-4625-b510-0a8aefe07736 Jul 03 13:59:01 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:02 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b9c78f0-2143-4625-b510-0a8aefe07736" returned: 0 in 0.715s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:59:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:02 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=75,cinder:UPDATE=100,cinder:DELETE=7,cinder:INSERT=19 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:59:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf6fddc-db6e-480c-9394-1684b1f8c856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b9c78f0-2143-4625-b510-0a8aefe07736', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99be503c-473e-4ec2-bf5a-ad3f72288338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:02 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=75,cinder:UPDATE=92,cinder:INSERT=26,cinder:DELETE=8 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:59:02 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Volume volume-5b9c78f0-2143-4625-b510-0a8aefe07736 (5b9c78f0-2143-4625-b510-0a8aefe07736): created successfully Jul 03 13:59:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99be503c-473e-4ec2-bf5a-ad3f72288338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Flow 'volume_create_manager' (01151536-fbee-4c8d-9c1e-3406e44fd756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:02 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-143bdbcc-4b76-433a-873b-20c2737af420 tempest-VolumesServicesTestJSON-421961567 None] Created volume successfully. Jul 03 13:59:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] Acquiring lock "cinder-5b9c78f0-2143-4625-b510-0a8aefe07736-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] Lock "cinder-5b9c78f0-2143-4625-b510-0a8aefe07736-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] Acquiring lock "cinder-quobyte-5b9c78f0-2143-4625-b510-0a8aefe07736" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] Lock "cinder-quobyte-5b9c78f0-2143-4625-b510-0a8aefe07736" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:03 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f53b31-1f30-434d-b293-fd0e96293696]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b9c78f0-2143-4625-b510-0a8aefe07736 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:03 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b9c78f0-2143-4625-b510-0a8aefe07736 Jul 03 13:59:03 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Flow 'volume_create_manager' (dcb99da0-6539-4007-affe-25c45408d61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4bcbab9-7188-4687-8f46-05b5dfbc62a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4bcbab9-7188-4687-8f46-05b5dfbc62a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-367149007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180d853e-7da7-496a-bf7d-6d7ac9c790aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d00dabeb6134f07a08f0f7e6d3c968c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:04Z,use_quota=True,user_id='249512cbe5244da3885e4a82de1dbb4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caaa237d-0fab-4e60-9e94-e60ed496694f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caaa237d-0fab-4e60-9e94-e60ed496694f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd113d3-6e94-4347-931b-b204e2330c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd113d3-6e94-4347-931b-b204e2330c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '180d853e-7da7-496a-bf7d-6d7ac9c790aa', 'volume_name': 'volume-180d853e-7da7-496a-bf7d-6d7ac9c790aa', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213ead3b-8d09-4966-b5d1-50306600acbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213ead3b-8d09-4966-b5d1-50306600acbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5193356a-2a05-4725-bd9d-c4f70a08ccee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:04 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Volume 180d853e-7da7-496a-bf7d-6d7ac9c790aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-180d853e-7da7-496a-bf7d-6d7ac9c790aa', 'volume_size': 1} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-367149007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180d853e-7da7-496a-bf7d-6d7ac9c790aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d00dabeb6134f07a08f0f7e6d3c968c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:04Z,use_quota=True,user_id='249512cbe5244da3885e4a82de1dbb4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Creating volume 180d853e-7da7-496a-bf7d-6d7ac9c790aa {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:59:04 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-180d853e-7da7-496a-bf7d-6d7ac9c790aa 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:04 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-180d853e-7da7-496a-bf7d-6d7ac9c790aa 1073741824 Jul 03 13:59:04 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:04 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b9c78f0-2143-4625-b510-0a8aefe07736" returned: 0 in 0.951s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b9c78f0-2143-4625-b510-0a8aefe07736 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:04 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b9c78f0-2143-4625-b510-0a8aefe07736 Jul 03 13:59:04 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Flow 'volume_create_manager' (ba117f62-0c73-48dc-8970-05aea91d954b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afb605e-1836-4a44-a4fd-f547bca36966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afb605e-1836-4a44-a4fd-f547bca36966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-873600216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b40267-0942-4880-975e-bb24266ed991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed64b475fa2c4c9abb08a8435f504131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:05Z,use_quota=True,user_id='d660b72d9dc84120858921f15fcecec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927414db-ecdb-4821-8b53-2c7e88728fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927414db-ecdb-4821-8b53-2c7e88728fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (599a504f-7e0e-4345-b80c-4a82019fb85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (599a504f-7e0e-4345-b80c-4a82019fb85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b40267-0942-4880-975e-bb24266ed991', 'volume_name': 'volume-f4b40267-0942-4880-975e-bb24266ed991', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b779603-8e9d-469c-9ad7-08135c530bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b779603-8e9d-469c-9ad7-08135c530bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27eed839-5dbd-44e2-a0f2-dcb0167087e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:05 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Volume f4b40267-0942-4880-975e-bb24266ed991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b40267-0942-4880-975e-bb24266ed991', 'volume_size': 1} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:05 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-180d853e-7da7-496a-bf7d-6d7ac9c790aa 1073741824" returned: 0 in 0.998s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-180d853e-7da7-496a-bf7d-6d7ac9c790aa {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:05 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-180d853e-7da7-496a-bf7d-6d7ac9c790aa Jul 03 13:59:05 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:05 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b9c78f0-2143-4625-b510-0a8aefe07736" returned: 0 in 0.745s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] Lock "cinder-quobyte-5b9c78f0-2143-4625-b510-0a8aefe07736" released by "delete_volume" :: held 1.757s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] Created reservations ['0855305a-6140-4452-897b-ad8dc84f6ba5', '04a6e3b0-6973-45a3-87b2-8ecc46b5f7b4', 'e86e846e-76ea-498e-bc2d-d7aed6267950', '02b83453-d730-487e-a26d-fcef84f49984'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:05 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:59:05 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:05 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-180d853e-7da7-496a-bf7d-6d7ac9c790aa" returned: 0 in 0.653s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.773s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-873600216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b40267-0942-4880-975e-bb24266ed991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed64b475fa2c4c9abb08a8435f504131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:05Z,use_quota=True,user_id='d660b72d9dc84120858921f15fcecec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Creating volume f4b40267-0942-4880-975e-bb24266ed991 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:59:05 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f4b40267-0942-4880-975e-bb24266ed991 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5193356a-2a05-4725-bd9d-c4f70a08ccee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-180d853e-7da7-496a-bf7d-6d7ac9c790aa', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:05 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f4b40267-0942-4880-975e-bb24266ed991 1073741824 Jul 03 13:59:05 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec70b06b-90e0-4271-b4fb-1c1b408e3143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:05 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Volume volume-180d853e-7da7-496a-bf7d-6d7ac9c790aa (180d853e-7da7-496a-bf7d-6d7ac9c790aa): created successfully Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec70b06b-90e0-4271-b4fb-1c1b408e3143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Flow 'volume_create_manager' (dcb99da0-6539-4007-affe-25c45408d61d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:06 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-d04e6c0e-b749-4c0b-bc40-cb30d9834fb3 tempest-AttachVolumeShelveTestJSON-175580758 None] Created volume successfully. Jul 03 13:59:06 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.812s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:06 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:59:06 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] Deleted volume successfully. Jul 03 13:59:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a1826312-aa05-4a8e-afa2-80816528431b tempest-VolumesServicesTestJSON-421961567 None] Lock "cinder-5b9c78f0-2143-4625-b510-0a8aefe07736-delete_volume" released by "delete_volume" :: held 2.813s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:07 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f4b40267-0942-4880-975e-bb24266ed991 1073741824" returned: 0 in 1.365s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f4b40267-0942-4880-975e-bb24266ed991 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:07 devstack sudo[94276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f4b40267-0942-4880-975e-bb24266ed991 Jul 03 13:59:07 devstack sudo[94276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:08 devstack sudo[94276]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f4b40267-0942-4880-975e-bb24266ed991" returned: 0 in 0.903s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] <== create_volume: return (2326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:59:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.329s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27eed839-5dbd-44e2-a0f2-dcb0167087e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b40267-0942-4880-975e-bb24266ed991', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3392ec3b-ceb2-4a53-a147-222d9b025d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:08 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Volume volume-f4b40267-0942-4880-975e-bb24266ed991 (f4b40267-0942-4880-975e-bb24266ed991): created successfully Jul 03 13:59:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3392ec3b-ceb2-4a53-a147-222d9b025d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Flow 'volume_create_manager' (ba117f62-0c73-48dc-8970-05aea91d954b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:08 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-424423e3-b65c-413f-9a74-ba66cd689b83 tempest-VolumesTransfersV357Test-549028126 None] Created volume successfully. Jul 03 13:59:10 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-44507e81-3d48-4512-9b90-4f81cdea4f3e tempest-VolumesTransfersV357Test-1016813966 None] Transfer volume completed successfully. Jul 03 13:59:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] Acquiring lock "cinder-f4b40267-0942-4880-975e-bb24266ed991-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] Lock "cinder-f4b40267-0942-4880-975e-bb24266ed991-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] Acquiring lock "cinder-quobyte-f4b40267-0942-4880-975e-bb24266ed991" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] Lock "cinder-quobyte-f4b40267-0942-4880-975e-bb24266ed991" acquired by "delete_volume" :: waited 0.021s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:11 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b53c6e-5714-413c-b26d-23a5b8e1811e]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f4b40267-0942-4880-975e-bb24266ed991 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:12 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f4b40267-0942-4880-975e-bb24266ed991 Jul 03 13:59:12 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:12 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f4b40267-0942-4880-975e-bb24266ed991" returned: 0 in 0.895s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f4b40267-0942-4880-975e-bb24266ed991 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:12 devstack sudo[94334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f4b40267-0942-4880-975e-bb24266ed991 Jul 03 13:59:12 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:13 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f4b40267-0942-4880-975e-bb24266ed991" returned: 0 in 0.839s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] Lock "cinder-quobyte-f4b40267-0942-4880-975e-bb24266ed991" released by "delete_volume" :: held 1.790s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:13 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] Created reservations ['889d92bb-a594-45b7-ab57-1005e015a9d6', '4aad6cb1-d55a-4fcc-b49e-3068ad6e5ce3', '707092d4-9454-4c40-abc4-ca5723ccd1ad', '256db12f-6d89-4047-91e2-32f04eef3a39'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:59:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:13 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:59:13 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Flow 'volume_create_manager' (3d9c2915-0ce2-492a-8841-6a535bf13183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeec7a2c-7f28-4632-b1d6-16133776e290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeec7a2c-7f28-4632-b1d6-16133776e290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-718596171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993e8b48-f06b-46ad-8f11-6dd40a40c821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed64b475fa2c4c9abb08a8435f504131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:15Z,use_quota=True,user_id='d660b72d9dc84120858921f15fcecec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff54d992-9566-4c28-8441-67c038661bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff54d992-9566-4c28-8441-67c038661bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f651a3-205d-49de-b963-7f754ac81db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f651a3-205d-49de-b963-7f754ac81db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '993e8b48-f06b-46ad-8f11-6dd40a40c821', 'volume_name': 'volume-993e8b48-f06b-46ad-8f11-6dd40a40c821', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381834a8-1106-434a-9dc0-25ac0082db50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381834a8-1106-434a-9dc0-25ac0082db50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748f70f7-f339-41b7-bc6a-2bfeb627f531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:14 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Volume 993e8b48-f06b-46ad-8f11-6dd40a40c821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-993e8b48-f06b-46ad-8f11-6dd40a40c821', 'volume_size': 1} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:14 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-718596171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993e8b48-f06b-46ad-8f11-6dd40a40c821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed64b475fa2c4c9abb08a8435f504131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:15Z,use_quota=True,user_id='d660b72d9dc84120858921f15fcecec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Creating volume 993e8b48-f06b-46ad-8f11-6dd40a40c821 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:59:14 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-993e8b48-f06b-46ad-8f11-6dd40a40c821 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.062s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:14 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:59:14 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] Deleted volume successfully. Jul 03 13:59:14 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-993e8b48-f06b-46ad-8f11-6dd40a40c821 1073741824 Jul 03 13:59:14 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-80820cae-85ab-4eba-a9e5-9c7038134758 tempest-VolumesTransfersV357Test-975593098 None] Lock "cinder-f4b40267-0942-4880-975e-bb24266ed991-delete_volume" released by "delete_volume" :: held 3.170s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:16 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-993e8b48-f06b-46ad-8f11-6dd40a40c821 1073741824" returned: 0 in 1.231s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-993e8b48-f06b-46ad-8f11-6dd40a40c821 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:16 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-993e8b48-f06b-46ad-8f11-6dd40a40c821 Jul 03 13:59:16 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:17 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-993e8b48-f06b-46ad-8f11-6dd40a40c821" returned: 0 in 0.988s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] <== create_volume: return (2280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:59:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.284s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748f70f7-f339-41b7-bc6a-2bfeb627f531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-993e8b48-f06b-46ad-8f11-6dd40a40c821', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3565f4-e1c5-4152-856c-7b0c08709f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:17 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Volume volume-993e8b48-f06b-46ad-8f11-6dd40a40c821 (993e8b48-f06b-46ad-8f11-6dd40a40c821): created successfully Jul 03 13:59:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3565f4-e1c5-4152-856c-7b0c08709f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Flow 'volume_create_manager' (3d9c2915-0ce2-492a-8841-6a535bf13183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:17 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-a74b0d40-df24-442e-b0c2-71eca5aa022f tempest-VolumesTransfersV357Test-549028126 None] Created volume successfully. Jul 03 13:59:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] Acquiring lock "cinder-993e8b48-f06b-46ad-8f11-6dd40a40c821-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] Lock "cinder-993e8b48-f06b-46ad-8f11-6dd40a40c821-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] Acquiring lock "cinder-quobyte-993e8b48-f06b-46ad-8f11-6dd40a40c821" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] Lock "cinder-quobyte-993e8b48-f06b-46ad-8f11-6dd40a40c821" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:18 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebf656b-8e89-422e-9346-0d8f1112280a]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-993e8b48-f06b-46ad-8f11-6dd40a40c821 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:18 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-993e8b48-f06b-46ad-8f11-6dd40a40c821 Jul 03 13:59:18 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:19 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-993e8b48-f06b-46ad-8f11-6dd40a40c821" returned: 0 in 0.859s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-993e8b48-f06b-46ad-8f11-6dd40a40c821 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:19 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-993e8b48-f06b-46ad-8f11-6dd40a40c821 Jul 03 13:59:19 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Flow 'volume_create_manager' (d51583d5-ccef-426a-afe6-60f1a9fbeb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58489857-8275-49dd-a87f-c58692caf55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58489857-8275-49dd-a87f-c58692caf55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-482470581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3064ebf-a6f6-4666-8aee-426fef33a35b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6bfbe39a761456f9bf934891d070744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:20Z,use_quota=True,user_id='08b5179787b64efe9faf737719257847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6769ed8-8402-46f6-bd71-c9bedee1799e),volume_type_id=b6769ed8-8402-46f6-bd71-c9bedee1799e)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2fb050-a4b5-4bda-95af-b748c704a8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2fb050-a4b5-4bda-95af-b748c704a8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96209b4-29b6-44f9-a039-72c95de41f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96209b4-29b6-44f9-a039-72c95de41f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3064ebf-a6f6-4666-8aee-426fef33a35b', 'volume_name': 'volume-d3064ebf-a6f6-4666-8aee-426fef33a35b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a591635-5f8b-420f-84b3-0ff1afc3de62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a591635-5f8b-420f-84b3-0ff1afc3de62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e94792c-0e6c-4190-9282-51c2703dbce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:19 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Volume d3064ebf-a6f6-4666-8aee-426fef33a35b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3064ebf-a6f6-4666-8aee-426fef33a35b', 'volume_size': 1} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-482470581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3064ebf-a6f6-4666-8aee-426fef33a35b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6bfbe39a761456f9bf934891d070744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:20Z,use_quota=True,user_id='08b5179787b64efe9faf737719257847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6769ed8-8402-46f6-bd71-c9bedee1799e),volume_type_id=b6769ed8-8402-46f6-bd71-c9bedee1799e)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Creating volume d3064ebf-a6f6-4666-8aee-426fef33a35b {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:59:19 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:59:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d3064ebf-a6f6-4666-8aee-426fef33a35b 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:19 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d3064ebf-a6f6-4666-8aee-426fef33a35b 1073741824 Jul 03 13:59:19 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:20 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-993e8b48-f06b-46ad-8f11-6dd40a40c821" returned: 0 in 0.737s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] Lock "cinder-quobyte-993e8b48-f06b-46ad-8f11-6dd40a40c821" released by "delete_volume" :: held 1.646s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:20 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] Created reservations ['a278e0ab-856c-45b3-b794-8551bfdaef2f', 'f3f0bc55-6fbd-4ca4-9eeb-24f0415a2272', '319ba657-7d11-4632-9154-491feee62be0', '6d952973-5485-4805-89ea-837bc60b63d7'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:59:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:20 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:59:20 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:20 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d3064ebf-a6f6-4666-8aee-426fef33a35b 1073741824" returned: 0 in 1.167s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d3064ebf-a6f6-4666-8aee-426fef33a35b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:20 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d3064ebf-a6f6-4666-8aee-426fef33a35b Jul 03 13:59:20 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:21 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.048s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:21 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:59:21 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] Deleted volume successfully. Jul 03 13:59:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7a6746c4-27e7-492c-8094-efaa84900193 tempest-VolumesTransfersV357Test-975593098 None] Lock "cinder-993e8b48-f06b-46ad-8f11-6dd40a40c821-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:21 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d3064ebf-a6f6-4666-8aee-426fef33a35b" returned: 0 in 0.971s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] <== create_volume: return (2191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:59:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e94792c-0e6c-4190-9282-51c2703dbce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3064ebf-a6f6-4666-8aee-426fef33a35b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b718f5-d443-4d29-a4d4-9aa2d83fc3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:21 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Volume volume-d3064ebf-a6f6-4666-8aee-426fef33a35b (d3064ebf-a6f6-4666-8aee-426fef33a35b): created successfully Jul 03 13:59:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b718f5-d443-4d29-a4d4-9aa2d83fc3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Flow 'volume_create_manager' (d51583d5-ccef-426a-afe6-60f1a9fbeb2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:21 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-7a086975-5373-4e27-9403-3e9e8cad9185 tempest-VolumeTypesAccessTest-2052393861 None] Created volume successfully. Jul 03 13:59:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Acquiring lock "cinder-d3064ebf-a6f6-4666-8aee-426fef33a35b-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Lock "cinder-d3064ebf-a6f6-4666-8aee-426fef33a35b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Acquiring lock "cinder-quobyte-d3064ebf-a6f6-4666-8aee-426fef33a35b" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Lock "cinder-quobyte-d3064ebf-a6f6-4666-8aee-426fef33a35b" acquired by "delete_volume" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:23 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7385ac6c-3170-4a18-a44c-b8784590c814]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d3064ebf-a6f6-4666-8aee-426fef33a35b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-f399e44e-1d7d-4781-8c12-6b46607d1527 req-fdfad471-762b-4c2e-964f-86749ef5aeb7 tempest-AttachVolumeShelveTestJSON-175580758 None] No connector for attachment c90b3e56-69d7-4630-9fe5-0e123e73d804; skipping storage backend terminate_connection call. {{(pid=86805) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 03 13:59:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-f399e44e-1d7d-4781-8c12-6b46607d1527 req-fdfad471-762b-4c2e-964f-86749ef5aeb7 tempest-AttachVolumeShelveTestJSON-175580758 None] Deleting attachment c90b3e56-69d7-4630-9fe5-0e123e73d804. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:59:23 devstack sudo[94426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d3064ebf-a6f6-4666-8aee-426fef33a35b Jul 03 13:59:23 devstack sudo[94426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:24 devstack sudo[94426]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d3064ebf-a6f6-4666-8aee-426fef33a35b" returned: 0 in 1.515s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d3064ebf-a6f6-4666-8aee-426fef33a35b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:24 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d3064ebf-a6f6-4666-8aee-426fef33a35b Jul 03 13:59:24 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:26 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d3064ebf-a6f6-4666-8aee-426fef33a35b" returned: 0 in 1.542s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Lock "cinder-quobyte-d3064ebf-a6f6-4666-8aee-426fef33a35b" released by "delete_volume" :: held 3.141s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:26 devstack cinder-volume[86805]: WARNING cinder.quota [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1676989107 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1676989107, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:59:26 devstack cinder-volume[86805]: WARNING cinder.quota [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1676989107 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1676989107, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:59:26 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Created reservations ['ba919019-ff21-418f-9406-d34e23200e6f', 'd1f4b257-7c32-432a-86dd-1d17c160b27c', 'f706c1fc-86bd-43e6-b82e-d5a20dd177b6', 'b9901956-9453-435e-b938-94a5150b9a14'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:59:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:26 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:59:26 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:27 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.262s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:27 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:59:27 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Deleted volume successfully. Jul 03 13:59:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-75bf52f6-82fa-4454-a9fb-f8265d5c2fa3 tempest-VolumeTypesAccessTest-2052393861 None] Lock "cinder-d3064ebf-a6f6-4666-8aee-426fef33a35b-delete_volume" released by "delete_volume" :: held 4.918s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Flow 'volume_create_manager' (7b7c9821-fc16-4aea-b6d1-ffb3af79c4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cedd29a8-4d90-4233-ac9b-0f6c5c38429f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cedd29a8-4d90-4233-ac9b-0f6c5c38429f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1092856071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29b0c5b-fdc1-40a8-8268-cf9b7d62d217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecbe933f6854927ada6e0c05df1e910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:31Z,use_quota=True,user_id='6a7e7b2656014179a8a15bc00af20e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5d6b89-ab16-4fec-976a-f45ba09d4e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5d6b89-ab16-4fec-976a-f45ba09d4e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b7e4dd-39fc-4885-a1fb-c04320671d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b7e4dd-39fc-4885-a1fb-c04320671d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e29b0c5b-fdc1-40a8-8268-cf9b7d62d217', 'volume_name': 'volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77bf3d86-f77f-467d-b6ea-66c1dd2ae519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77bf3d86-f77f-467d-b6ea-66c1dd2ae519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c205840a-4bea-4e37-a659-59613628f26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:31 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Volume e29b0c5b-fdc1-40a8-8268-cf9b7d62d217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217', 'volume_size': 1} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1092856071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29b0c5b-fdc1-40a8-8268-cf9b7d62d217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecbe933f6854927ada6e0c05df1e910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:31Z,use_quota=True,user_id='6a7e7b2656014179a8a15bc00af20e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Creating volume e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:59:31 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 13:59:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:31 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 1073741824 Jul 03 13:59:31 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:32 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 1073741824" returned: 0 in 1.171s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:32 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 Jul 03 13:59:32 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:33 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217" returned: 0 in 0.882s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:59:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.119s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:33 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c205840a-4bea-4e37-a659-59613628f26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:33 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad20de3-4680-46d7-840e-b2ec1b30f9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:33 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Volume volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 (e29b0c5b-fdc1-40a8-8268-cf9b7d62d217): created successfully Jul 03 13:59:33 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad20de3-4680-46d7-840e-b2ec1b30f9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:33 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Flow 'volume_create_manager' (7b7c9821-fc16-4aea-b6d1-ffb3af79c4a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:33 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e73e0a3a-416d-4368-8443-6c2b9e7b0af7 tempest-VolumesCloneTest-579697320 None] Created volume successfully. Jul 03 13:59:35 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:59:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Flow 'volume_create_manager' (63ce4928-81ed-4aa0-b792-e8922297dcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f184efb-5310-4a1a-9471-283fa62d733c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f184efb-5310-4a1a-9471-283fa62d733c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1695192075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8754a1f7-5bac-460b-be84-ea147cf4d35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecbe933f6854927ada6e0c05df1e910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e29b0c5b-fdc1-40a8-8268-cf9b7d62d217,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:35Z,use_quota=True,user_id='6a7e7b2656014179a8a15bc00af20e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4381371-8e28-4be5-850c-8219af00cac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4381371-8e28-4be5-850c-8219af00cac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99596c7c-a7c0-447e-bd63-1ee03191dec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99596c7c-a7c0-447e-bd63-1ee03191dec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8754a1f7-5bac-460b-be84-ea147cf4d35d', 'volume_name': 'volume-8754a1f7-5bac-460b-be84-ea147cf4d35d', 'volume_size': 2, 'source_volid': 'e29b0c5b-fdc1-40a8-8268-cf9b7d62d217', 'source_volstatus': 'available'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b646d5ab-d6bf-4ea3-ab65-17bb34a1a103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b646d5ab-d6bf-4ea3-ab65-17bb34a1a103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ceb389-800d-4ff8-ad1e-135e817f183f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:35 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Volume 8754a1f7-5bac-460b-be84-ea147cf4d35d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8754a1f7-5bac-460b-be84-ea147cf4d35d', 'volume_size': 2, 'source_volid': 'e29b0c5b-fdc1-40a8-8268-cf9b7d62d217', 'source_volstatus': 'available'} Jul 03 13:59:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:35 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Cloning volume e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 to volume 8754a1f7-5bac-460b-be84-ea147cf4d35d Jul 03 13:59:35 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Creating offline snapshot e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 of volume e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:59:35 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96ba5b9-f114-4a8e-ae65-9ee7bf1e9c87]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:35 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 Jul 03 13:59:35 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:36 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217" returned: 0 in 0.954s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:36 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 1G Jul 03 13:59:36 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:37 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 1G" returned: 0 in 1.174s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:37 devstack sudo[94506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 Jul 03 13:59:37 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:38 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5" returned: 0 in 1.182s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:38 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 is being set with open permissions: ugo+rw Jul 03 13:59:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:38 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 Jul 03 13:59:38 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:39 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5" returned: 0 in 0.803s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:39 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.info Jul 03 13:59:39 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:40 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.info" returned: 0 in 0.719s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:40 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.info is being set with open permissions: ugo+rw Jul 03 13:59:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:40 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.info Jul 03 13:59:40 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:41 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.info" returned: 0 in 0.707s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Acquiring lock "cinder-quobyte-8754a1f7-5bac-460b-be84-ea147cf4d35d" by "_copy_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Lock "cinder-quobyte-8754a1f7-5bac-460b-be84-ea147cf4d35d" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] snapshot: e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5, volume: 8754a1f7-5bac-460b-be84-ea147cf4d35d, {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 13:59:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:41 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ace1b6f-4119-4be9-a46d-116de9e243bc]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:41 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 Jul 03 13:59:41 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:42 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5" returned: 0 in 0.935s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:59:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] will copy from snapshot at /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 13:59:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Creating direct copy from snapshot {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 13:59:42 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[df53b595-4e06-4a7c-a5d6-94a812e615d3]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:42 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 Jul 03 13:59:42 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:42 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217" returned: 0 in 0.834s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:42 devstack cinder-volume[86805]: DEBUG cinder.utils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Path /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8754a1f7-5bac-460b-be84-ea147cf4d35d not found in is_blk_device check {{(pid=86805) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 13:59:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8754a1f7-5bac-460b-be84-ea147cf4d35d {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:42 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8754a1f7-5bac-460b-be84-ea147cf4d35d Jul 03 13:59:42 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:49 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=38,cinder:UPDATE=47,cinder:INSERT=12,cinder:DELETE=6 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:59:49 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=50,cinder:DELETE=4,cinder:SELECT=33,cinder:INSERT=11 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:59:51 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8754a1f7-5bac-460b-be84-ea147cf4d35d" returned: 0 in 8.974s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:51 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9356ecf4-9994-41d4-92b3-565c19d6dc20]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:52 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 Jul 03 13:59:52 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:53 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217" returned: 0 in 1.908s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:53 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Image conversion details: src /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217, size 1024.00 MB, duration 8.98 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8754a1f7-5bac-460b-be84-ea147cf4d35d {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:59:53 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Converted 1024.00 MB image at 114.08 MB/s Jul 03 13:59:53 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8754a1f7-5bac-460b-be84-ea147cf4d35d is being set with open permissions: ugo+rw Jul 03 13:59:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8754a1f7-5bac-460b-be84-ea147cf4d35d {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:53 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8754a1f7-5bac-460b-be84-ea147cf4d35d Jul 03 13:59:53 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:55 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8754a1f7-5bac-460b-be84-ea147cf4d35d" returned: 0 in 1.435s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:55 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Lock "cinder-quobyte-8754a1f7-5bac-460b-be84-ea147cf4d35d" released by "_copy_volume_from_snapshot" :: held 14.244s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:55 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Acquiring lock "cinder-quobyte-e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:55 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Lock "cinder-quobyte-e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Deleting offline snapshot e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 of volume e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:59:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] snapshot_file for this snap is: volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:59:55 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[54345796-565c-476f-907a-4946106ab70a]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:55 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 Jul 03 13:59:55 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:56 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5" returned: 0 in 1.396s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:59:56 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e4e756-11d4-402f-92d6-ae10ff283760]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:57 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 Jul 03 13:59:57 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:58 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217" returned: 0 in 1.155s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:58 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 Jul 03 13:59:58 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:59:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:58 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 13:59:58 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:59 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5" returned: 0 in 1.056s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:59 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5 Jul 03 13:59:59 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:59 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.237s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:00:00 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217.e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5" returned: 0 in 1.103s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Lock "cinder-quobyte-e74ed6f3-5af7-4afc-9eff-b7e18c4d9fd5" released by "_delete_snapshot" :: held 4.859s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.964s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ceb389-800d-4ff8-ad1e-135e817f183f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8754a1f7-5bac-460b-be84-ea147cf4d35d', 'volume_size': 2, 'source_volid': 'e29b0c5b-fdc1-40a8-8268-cf9b7d62d217', 'source_volstatus': 'available'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd8b111-58e8-40a5-bc2a-84b4bbcf2185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:00 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Volume volume-8754a1f7-5bac-460b-be84-ea147cf4d35d (8754a1f7-5bac-460b-be84-ea147cf4d35d): created successfully Jul 03 14:00:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd8b111-58e8-40a5-bc2a-84b4bbcf2185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Flow 'volume_create_manager' (63ce4928-81ed-4aa0-b792-e8922297dcc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:00 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-68ab1cd2-c6d7-4d5f-bfe9-d4de113887ac tempest-VolumesCloneTest-579697320 None] Created volume successfully. Jul 03 14:00:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] Acquiring lock "cinder-8754a1f7-5bac-460b-be84-ea147cf4d35d-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] Lock "cinder-8754a1f7-5bac-460b-be84-ea147cf4d35d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] Acquiring lock "cinder-quobyte-8754a1f7-5bac-460b-be84-ea147cf4d35d" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] Lock "cinder-quobyte-8754a1f7-5bac-460b-be84-ea147cf4d35d" acquired by "delete_volume" :: waited 0.028s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:01 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8963e828-fee3-45d3-8c58-7e977be7c31d]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8754a1f7-5bac-460b-be84-ea147cf4d35d {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:01 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8754a1f7-5bac-460b-be84-ea147cf4d35d Jul 03 14:00:01 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:02 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8754a1f7-5bac-460b-be84-ea147cf4d35d" returned: 0 in 1.007s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8754a1f7-5bac-460b-be84-ea147cf4d35d {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:02 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8754a1f7-5bac-460b-be84-ea147cf4d35d Jul 03 14:00:02 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:02 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8754a1f7-5bac-460b-be84-ea147cf4d35d" returned: 0 in 0.724s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:02 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] Lock "cinder-quobyte-8754a1f7-5bac-460b-be84-ea147cf4d35d" released by "delete_volume" :: held 1.809s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:02 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] Created reservations ['42becafe-cda0-47b8-816f-c1b5dedd1a8b', 'a846ec0d-14e8-42ee-aaa2-155d6e6c1fa0', '02aa5595-06fb-47f2-a64e-7072215ab1de', 'efd95ad9-3f4e-47dd-b92d-225b61c740bb'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:03 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:03 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:03 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:00:03 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] Acquiring lock "cinder-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] Lock "cinder-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] Acquiring lock "cinder-quobyte-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] Lock "cinder-quobyte-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217" acquired by "delete_volume" :: waited 0.023s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:03 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43af33d-66cb-465f-b6f3-e00d73ece6d1]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:03 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 Jul 03 14:00:03 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:03 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.864s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:03 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:00:03 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] Deleted volume successfully. Jul 03 14:00:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9b5111f6-148b-4bf6-9fb2-b08eac990e63 tempest-VolumesCloneTest-579697320 None] Lock "cinder-8754a1f7-5bac-460b-be84-ea147cf4d35d-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:04 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217" returned: 0 in 0.788s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:04 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217 Jul 03 14:00:04 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:04 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-1591703a-4998-4f0e-920d-9bfa7140283c req-befcf18a-c4a9-42eb-82b0-1a975b76ab7d tempest-AttachVolumeNegativeTest-1388742330 None] Terminate volume connection completed successfully. Jul 03 14:00:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-1591703a-4998-4f0e-920d-9bfa7140283c req-befcf18a-c4a9-42eb-82b0-1a975b76ab7d tempest-AttachVolumeNegativeTest-1388742330 None] Deleting attachment e3a22216-1b07-4d61-a4fa-d4edab6db3f3. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:00:05 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217" returned: 0 in 0.710s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:05 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] Lock "cinder-quobyte-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217" released by "delete_volume" :: held 1.570s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:05 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] Created reservations ['529d43c9-d25d-42a0-94a3-2a02585b5469', '031ba23b-8fbe-4431-a3a2-2c2b907c0959', 'b6f31d3a-2430-4e68-a3d6-3cf648616183', 'cb9fcea0-f7f3-444e-a138-bb9e1b645a2d'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:05 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:00:05 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:06 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.851s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:06 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:00:06 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] Deleted volume successfully. Jul 03 14:00:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-222a0a77-94a3-4b59-9090-ca4482d64355 tempest-VolumesCloneTest-579697320 None] Lock "cinder-e29b0c5b-fdc1-40a8-8268-cf9b7d62d217-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Flow 'volume_create_manager' (c161cac2-b1c4-49e7-bf48-d891c1c781ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4adb67e-954b-4c2b-ac35-3ee24280def5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4adb67e-954b-4c2b-ac35-3ee24280def5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-944044901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b7e1e4-23b2-4572-ad91-c14ada5ac459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f081bf39aae641a4a48870559fb647bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:09Z,use_quota=True,user_id='c92532c6a9844c8eb6c796ec3914c96d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebb3615-ccbe-4e1d-9ba4-a64d523e7441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebb3615-ccbe-4e1d-9ba4-a64d523e7441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bd6453-2ca1-40e5-b2c9-82ec3751f0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bd6453-2ca1-40e5-b2c9-82ec3751f0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b7e1e4-23b2-4572-ad91-c14ada5ac459', 'volume_name': 'volume-47b7e1e4-23b2-4572-ad91-c14ada5ac459', 'volume_size': 2}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2387385d-e049-4b36-8467-b32983d2ec82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2387385d-e049-4b36-8467-b32983d2ec82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7528066-5dde-4157-b2d9-c822993cdb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:09 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Volume 47b7e1e4-23b2-4572-ad91-c14ada5ac459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b7e1e4-23b2-4572-ad91-c14ada5ac459', 'volume_size': 2} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-944044901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b7e1e4-23b2-4572-ad91-c14ada5ac459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f081bf39aae641a4a48870559fb647bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:09Z,use_quota=True,user_id='c92532c6a9844c8eb6c796ec3914c96d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Creating volume 47b7e1e4-23b2-4572-ad91-c14ada5ac459 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:00:09 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:00:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-47b7e1e4-23b2-4572-ad91-c14ada5ac459 2147483648 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:09 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-47b7e1e4-23b2-4572-ad91-c14ada5ac459 2147483648 Jul 03 14:00:09 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:10 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-47b7e1e4-23b2-4572-ad91-c14ada5ac459 2147483648" returned: 0 in 1.166s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-47b7e1e4-23b2-4572-ad91-c14ada5ac459 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:10 devstack sudo[94900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-47b7e1e4-23b2-4572-ad91-c14ada5ac459 Jul 03 14:00:10 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:11 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-47b7e1e4-23b2-4572-ad91-c14ada5ac459" returned: 0 in 0.797s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:00:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7528066-5dde-4157-b2d9-c822993cdb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b7e1e4-23b2-4572-ad91-c14ada5ac459', 'volume_size': 2}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68508ad5-4dde-48be-8b8e-05b42d3aef81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:11 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Volume volume-47b7e1e4-23b2-4572-ad91-c14ada5ac459 (47b7e1e4-23b2-4572-ad91-c14ada5ac459): created successfully Jul 03 14:00:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68508ad5-4dde-48be-8b8e-05b42d3aef81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Flow 'volume_create_manager' (c161cac2-b1c4-49e7-bf48-d891c1c781ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:11 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ba1c4004-f283-441d-a167-2d56ccab3d46 tempest-VolumesCloneNegativeTest-51029538 None] Created volume successfully. Jul 03 14:00:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] Acquiring lock "cinder-47b7e1e4-23b2-4572-ad91-c14ada5ac459-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] Lock "cinder-47b7e1e4-23b2-4572-ad91-c14ada5ac459-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] Acquiring lock "cinder-quobyte-47b7e1e4-23b2-4572-ad91-c14ada5ac459" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] Lock "cinder-quobyte-47b7e1e4-23b2-4572-ad91-c14ada5ac459" acquired by "delete_volume" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:13 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[adea21d9-60e1-48ec-8c5c-3c36b760a0c5]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-47b7e1e4-23b2-4572-ad91-c14ada5ac459 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:13 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-47b7e1e4-23b2-4572-ad91-c14ada5ac459 Jul 03 14:00:13 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:13 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-47b7e1e4-23b2-4572-ad91-c14ada5ac459" returned: 0 in 0.902s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-47b7e1e4-23b2-4572-ad91-c14ada5ac459 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:13 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-47b7e1e4-23b2-4572-ad91-c14ada5ac459 Jul 03 14:00:13 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:14 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-47b7e1e4-23b2-4572-ad91-c14ada5ac459" returned: 0 in 0.756s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:14 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] Lock "cinder-quobyte-47b7e1e4-23b2-4572-ad91-c14ada5ac459" released by "delete_volume" :: held 1.737s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:14 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] Created reservations ['897ed1f3-0f87-4024-b039-5d87b9d2cf10', '095a725f-b312-4748-b79e-d98e7e667865', '5119ceec-3815-4e7f-ac0c-4591b64f0cbd', 'ed3d970e-b823-4a56-a63d-a75a6900d133'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:14 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:00:14 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:15 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.946s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:15 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:00:15 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] Deleted volume successfully. Jul 03 14:00:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-933607bc-735d-468e-aa3d-00a2a8b73abe tempest-VolumesCloneNegativeTest-51029538 None] Lock "cinder-47b7e1e4-23b2-4572-ad91-c14ada5ac459-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Flow 'volume_create_manager' (d746c28a-3d04-4fd3-bf60-67f58de34066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c144631-7044-4394-9b0b-6d6db0395296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c144631-7044-4394-9b0b-6d6db0395296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1906327476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4431f9-7919-4f72-a331-0854cb34bdce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6033755c0166499b9496f6c88fba8dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:21Z,use_quota=True,user_id='17c0496b43ed4c74b414984b32174852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb81514-6265-4f63-96b9-b8ee69b782f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb81514-6265-4f63-96b9-b8ee69b782f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ac1e62-9e40-4209-82b8-2e71ae76d952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ac1e62-9e40-4209-82b8-2e71ae76d952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e4431f9-7919-4f72-a331-0854cb34bdce', 'volume_name': 'volume-9e4431f9-7919-4f72-a331-0854cb34bdce', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a025f76d-9f74-4d3c-96c5-c2c2da84b530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a025f76d-9f74-4d3c-96c5-c2c2da84b530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597d1789-7efa-4e23-a455-63a05eb09e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:20 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Volume 9e4431f9-7919-4f72-a331-0854cb34bdce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e4431f9-7919-4f72-a331-0854cb34bdce', 'volume_size': 1} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1906327476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4431f9-7919-4f72-a331-0854cb34bdce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6033755c0166499b9496f6c88fba8dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:21Z,use_quota=True,user_id='17c0496b43ed4c74b414984b32174852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Creating volume 9e4431f9-7919-4f72-a331-0854cb34bdce {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:00:20 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:00:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9e4431f9-7919-4f72-a331-0854cb34bdce 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:20 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9e4431f9-7919-4f72-a331-0854cb34bdce 1073741824 Jul 03 14:00:20 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:21 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9e4431f9-7919-4f72-a331-0854cb34bdce 1073741824" returned: 0 in 1.004s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9e4431f9-7919-4f72-a331-0854cb34bdce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:21 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9e4431f9-7919-4f72-a331-0854cb34bdce Jul 03 14:00:21 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] Acquiring lock "cinder-180d853e-7da7-496a-bf7d-6d7ac9c790aa-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] Lock "cinder-180d853e-7da7-496a-bf7d-6d7ac9c790aa-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] Acquiring lock "cinder-quobyte-180d853e-7da7-496a-bf7d-6d7ac9c790aa" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] Lock "cinder-quobyte-180d853e-7da7-496a-bf7d-6d7ac9c790aa" acquired by "delete_volume" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:22 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6242398f-6983-4f44-ba9d-4620320aa8cc]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-180d853e-7da7-496a-bf7d-6d7ac9c790aa {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:22 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9e4431f9-7919-4f72-a331-0854cb34bdce" returned: 0 in 0.940s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:00:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597d1789-7efa-4e23-a455-63a05eb09e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e4431f9-7919-4f72-a331-0854cb34bdce', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786d4556-fab6-4cf1-952c-0691a8ee8ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:22 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Volume volume-9e4431f9-7919-4f72-a331-0854cb34bdce (9e4431f9-7919-4f72-a331-0854cb34bdce): created successfully Jul 03 14:00:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786d4556-fab6-4cf1-952c-0691a8ee8ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:22 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-180d853e-7da7-496a-bf7d-6d7ac9c790aa Jul 03 14:00:22 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Flow 'volume_create_manager' (d746c28a-3d04-4fd3-bf60-67f58de34066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:22 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-05fce153-b040-419c-a46c-fb0108c8e6bb tempest-VolumesListTestJSON-363576687 None] Created volume successfully. Jul 03 14:00:23 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-180d853e-7da7-496a-bf7d-6d7ac9c790aa" returned: 0 in 0.928s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-180d853e-7da7-496a-bf7d-6d7ac9c790aa {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:23 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-180d853e-7da7-496a-bf7d-6d7ac9c790aa Jul 03 14:00:23 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:24 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-180d853e-7da7-496a-bf7d-6d7ac9c790aa" returned: 0 in 0.776s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] Lock "cinder-quobyte-180d853e-7da7-496a-bf7d-6d7ac9c790aa" released by "delete_volume" :: held 1.770s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] Created reservations ['ce54842f-a702-41e1-8518-82cbaca34ba4', '80f00622-afa4-47db-819e-1da2bc07e400', '70f968c0-d294-4f91-abf6-532f666f4b5e', 'ac530a79-5dde-4538-9830-e3061a342cc0'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Flow 'volume_create_manager' (f28ce3b1-6f1a-43e5-8e2b-4e58e6e7ac37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84d8efd-58fd-403b-920d-6182abd9e752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84d8efd-58fd-403b-920d-6182abd9e752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1598963392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad12ebd-2612-424a-9cf8-498260d9247c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6033755c0166499b9496f6c88fba8dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:25Z,use_quota=True,user_id='17c0496b43ed4c74b414984b32174852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a41d39-8357-438f-844c-433463a4aec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a41d39-8357-438f-844c-433463a4aec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e84f9f-2e0d-4b9b-ba9f-6706ba637cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e84f9f-2e0d-4b9b-ba9f-6706ba637cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aad12ebd-2612-424a-9cf8-498260d9247c', 'volume_name': 'volume-aad12ebd-2612-424a-9cf8-498260d9247c', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de96dba-7734-4561-b099-a62ad7eb9fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de96dba-7734-4561-b099-a62ad7eb9fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa01f935-bf7e-4c4a-a492-6b2830fe8a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:24 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Volume aad12ebd-2612-424a-9cf8-498260d9247c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aad12ebd-2612-424a-9cf8-498260d9247c', 'volume_size': 1} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1598963392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad12ebd-2612-424a-9cf8-498260d9247c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6033755c0166499b9496f6c88fba8dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:25Z,use_quota=True,user_id='17c0496b43ed4c74b414984b32174852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Creating volume aad12ebd-2612-424a-9cf8-498260d9247c {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:00:24 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aad12ebd-2612-424a-9cf8-498260d9247c 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:24 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aad12ebd-2612-424a-9cf8-498260d9247c 1073741824 Jul 03 14:00:24 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:24 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:00:24 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:25 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.749s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:25 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:00:25 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] Deleted volume successfully. Jul 03 14:00:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3209bc09-7df5-4158-a47f-b61ba56baa76 tempest-AttachVolumeShelveTestJSON-175580758 None] Lock "cinder-180d853e-7da7-496a-bf7d-6d7ac9c790aa-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:25 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aad12ebd-2612-424a-9cf8-498260d9247c 1073741824" returned: 0 in 1.045s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aad12ebd-2612-424a-9cf8-498260d9247c {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:25 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aad12ebd-2612-424a-9cf8-498260d9247c Jul 03 14:00:25 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:26 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aad12ebd-2612-424a-9cf8-498260d9247c" returned: 0 in 0.700s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:00:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa01f935-bf7e-4c4a-a492-6b2830fe8a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aad12ebd-2612-424a-9cf8-498260d9247c', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c9cda1-57b4-4130-a2a8-9696552a76bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:26 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Volume volume-aad12ebd-2612-424a-9cf8-498260d9247c (aad12ebd-2612-424a-9cf8-498260d9247c): created successfully Jul 03 14:00:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c9cda1-57b4-4130-a2a8-9696552a76bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Flow 'volume_create_manager' (f28ce3b1-6f1a-43e5-8e2b-4e58e6e7ac37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:26 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-efb4d44c-40b9-4614-baf3-cc9a64ae7193 tempest-VolumesListTestJSON-363576687 None] Created volume successfully. Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Flow 'volume_create_manager' (a3575790-8160-461e-928d-a6f7ff023147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007121bc-b10c-4326-9166-012bc0951b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007121bc-b10c-4326-9166-012bc0951b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1720790479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00b05c9-4209-4696-bf1a-9b8c632587ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6033755c0166499b9496f6c88fba8dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:27Z,use_quota=True,user_id='17c0496b43ed4c74b414984b32174852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8899ffa-a4a0-46d3-a2ad-334a308683d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8899ffa-a4a0-46d3-a2ad-334a308683d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0a21c5-bb28-4852-b573-5569031ca2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0a21c5-bb28-4852-b573-5569031ca2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f00b05c9-4209-4696-bf1a-9b8c632587ce', 'volume_name': 'volume-f00b05c9-4209-4696-bf1a-9b8c632587ce', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8257a34c-397d-491f-9c7a-c424d062e813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8257a34c-397d-491f-9c7a-c424d062e813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5012eb2-23de-41cf-8fb7-5900c0ae98a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:27 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Volume f00b05c9-4209-4696-bf1a-9b8c632587ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f00b05c9-4209-4696-bf1a-9b8c632587ce', 'volume_size': 1} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1720790479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00b05c9-4209-4696-bf1a-9b8c632587ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6033755c0166499b9496f6c88fba8dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:27Z,use_quota=True,user_id='17c0496b43ed4c74b414984b32174852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Creating volume f00b05c9-4209-4696-bf1a-9b8c632587ce {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:00:27 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:00:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f00b05c9-4209-4696-bf1a-9b8c632587ce 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:27 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f00b05c9-4209-4696-bf1a-9b8c632587ce 1073741824 Jul 03 14:00:27 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:28 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f00b05c9-4209-4696-bf1a-9b8c632587ce 1073741824" returned: 0 in 1.179s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f00b05c9-4209-4696-bf1a-9b8c632587ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:28 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f00b05c9-4209-4696-bf1a-9b8c632587ce Jul 03 14:00:28 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:29 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f00b05c9-4209-4696-bf1a-9b8c632587ce" returned: 0 in 0.919s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:00:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5012eb2-23de-41cf-8fb7-5900c0ae98a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f00b05c9-4209-4696-bf1a-9b8c632587ce', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb18060-d6e9-4690-abb0-584b1e262530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:29 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Volume volume-f00b05c9-4209-4696-bf1a-9b8c632587ce (f00b05c9-4209-4696-bf1a-9b8c632587ce): created successfully Jul 03 14:00:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb18060-d6e9-4690-abb0-584b1e262530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Flow 'volume_create_manager' (a3575790-8160-461e-928d-a6f7ff023147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:29 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-71ea5028-84db-4a07-8694-d9efe681ddbc tempest-VolumesListTestJSON-363576687 None] Created volume successfully. Jul 03 14:00:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] Acquiring lock "cinder-f00b05c9-4209-4696-bf1a-9b8c632587ce-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] Lock "cinder-f00b05c9-4209-4696-bf1a-9b8c632587ce-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] Acquiring lock "cinder-quobyte-f00b05c9-4209-4696-bf1a-9b8c632587ce" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] Lock "cinder-quobyte-f00b05c9-4209-4696-bf1a-9b8c632587ce" acquired by "delete_volume" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:33 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[977b54a3-e1b7-4559-907e-b079baac7524]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f00b05c9-4209-4696-bf1a-9b8c632587ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:34 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f00b05c9-4209-4696-bf1a-9b8c632587ce Jul 03 14:00:34 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Flow 'volume_create_manager' (fa6d7c28-7cb7-45bb-a7b3-5c191b7b0245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b9e1980-6ba5-4a98-b353-54651c301251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b9e1980-6ba5-4a98-b353-54651c301251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1697904558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14d9dc1-7530-447c-9b1e-a0d540e51c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac67ccb12954de186230e37fbb750de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:34Z,use_quota=True,user_id='15975417cbec4ca7a4fbe183045437a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae1fec5f-1315-49a3-8acf-37dd5384528e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae1fec5f-1315-49a3-8acf-37dd5384528e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e59efae-30d8-4c42-8968-5f363ca6eaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e59efae-30d8-4c42-8968-5f363ca6eaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14d9dc1-7530-447c-9b1e-a0d540e51c4f', 'volume_name': 'volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc788ca-418d-4a52-ae8b-5a3d52f240d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc788ca-418d-4a52-ae8b-5a3d52f240d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64d5e83-21e8-473d-a25f-aa5bfca1875d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:34 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Volume f14d9dc1-7530-447c-9b1e-a0d540e51c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f', 'volume_size': 1} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1697904558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14d9dc1-7530-447c-9b1e-a0d540e51c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac67ccb12954de186230e37fbb750de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:34Z,use_quota=True,user_id='15975417cbec4ca7a4fbe183045437a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Creating volume f14d9dc1-7530-447c-9b1e-a0d540e51c4f {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:00:34 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:34 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f 1073741824 Jul 03 14:00:34 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:34 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f00b05c9-4209-4696-bf1a-9b8c632587ce" returned: 0 in 0.922s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f00b05c9-4209-4696-bf1a-9b8c632587ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:34 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f00b05c9-4209-4696-bf1a-9b8c632587ce Jul 03 14:00:34 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:35 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f 1073741824" returned: 0 in 0.881s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:35 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f00b05c9-4209-4696-bf1a-9b8c632587ce" returned: 0 in 0.710s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] Lock "cinder-quobyte-f00b05c9-4209-4696-bf1a-9b8c632587ce" released by "delete_volume" :: held 1.687s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:35 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f Jul 03 14:00:35 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:35 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] Created reservations ['fa1a1d3b-66ae-4c11-8de1-897fd02d4b7b', '585a8875-4818-498b-a2c1-629d1142ba6a', '917e6091-da52-4830-92f4-828ff17cb75d', '951c78ef-b5c7-40f9-8485-0647797c6f92'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:35 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:35 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:35 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:00:35 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] Acquiring lock "cinder-aad12ebd-2612-424a-9cf8-498260d9247c-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] Lock "cinder-aad12ebd-2612-424a-9cf8-498260d9247c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] Acquiring lock "cinder-quobyte-aad12ebd-2612-424a-9cf8-498260d9247c" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] Lock "cinder-quobyte-aad12ebd-2612-424a-9cf8-498260d9247c" acquired by "delete_volume" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:36 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fea88a-2c9d-46f9-a752-a46b6f69fe4e]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aad12ebd-2612-424a-9cf8-498260d9247c {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:36 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aad12ebd-2612-424a-9cf8-498260d9247c Jul 03 14:00:36 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:36 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f" returned: 0 in 1.073s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:00:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:36 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.925s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:36 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:00:36 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] Deleted volume successfully. Jul 03 14:00:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64d5e83-21e8-473d-a25f-aa5bfca1875d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b482fdd-6eea-4419-89be-30c5ab6b8120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:36 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Volume volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f (f14d9dc1-7530-447c-9b1e-a0d540e51c4f): created successfully Jul 03 14:00:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b482fdd-6eea-4419-89be-30c5ab6b8120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Flow 'volume_create_manager' (fa6d7c28-7cb7-45bb-a7b3-5c191b7b0245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ef611cde-2745-4464-a136-37277f9b03d7 tempest-VolumesListTestJSON-363576687 None] Lock "cinder-f00b05c9-4209-4696-bf1a-9b8c632587ce-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:36 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-300d3784-5b70-4a88-b144-5865052f8b91 req-c48f28fa-40c4-4295-8238-e14ea81358cd tempest-VolumesSnapshotsTestJSON-653432432 None] Created volume successfully. Jul 03 14:00:37 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aad12ebd-2612-424a-9cf8-498260d9247c" returned: 0 in 1.443s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aad12ebd-2612-424a-9cf8-498260d9247c {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:37 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aad12ebd-2612-424a-9cf8-498260d9247c Jul 03 14:00:37 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] Creating offline snapshot caa869ab-ebd4-46ca-b995-8a790cf02f65 of volume f14d9dc1-7530-447c-9b1e-a0d540e51c4f {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:00:38 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b79245-e3ce-45d5-b396-952f683942f5]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:38 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f Jul 03 14:00:38 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:38 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aad12ebd-2612-424a-9cf8-498260d9247c" returned: 0 in 1.044s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] Lock "cinder-quobyte-aad12ebd-2612-424a-9cf8-498260d9247c" released by "delete_volume" :: held 2.571s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:39 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] Created reservations ['3bdb3441-bcbf-4e76-bfcb-66067112cb58', '5ac6a1dd-cddd-4fe9-83e8-57f7473a9c81', '2dc24ca7-bb24-4e95-9f84-ebd511a57757', '27b183c9-5b5e-434d-b82d-8e8ef06ba6c9'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:39 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:00:39 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] Acquiring lock "cinder-9e4431f9-7919-4f72-a331-0854cb34bdce-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] Lock "cinder-9e4431f9-7919-4f72-a331-0854cb34bdce-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] Acquiring lock "cinder-quobyte-9e4431f9-7919-4f72-a331-0854cb34bdce" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] Lock "cinder-quobyte-9e4431f9-7919-4f72-a331-0854cb34bdce" acquired by "delete_volume" :: waited 0.057s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:40 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9bbb29-823b-4e60-b983-2e496ef271e0]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9e4431f9-7919-4f72-a331-0854cb34bdce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:40 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f" returned: 0 in 2.520s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:40 devstack sudo[95226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65 1G Jul 03 14:00:40 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:41 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9e4431f9-7919-4f72-a331-0854cb34bdce Jul 03 14:00:41 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:41 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.691s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:41 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:00:41 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] Deleted volume successfully. Jul 03 14:00:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67b6c805-7162-4328-978d-eadbf08d4ab3 tempest-VolumesListTestJSON-363576687 None] Lock "cinder-aad12ebd-2612-424a-9cf8-498260d9247c-delete_volume" released by "delete_volume" :: held 4.930s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:41 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65 1G" returned: 0 in 1.102s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:41 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65 Jul 03 14:00:41 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:42 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9e4431f9-7919-4f72-a331-0854cb34bdce" returned: 0 in 1.349s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9e4431f9-7919-4f72-a331-0854cb34bdce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:42 devstack sudo[95241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9e4431f9-7919-4f72-a331-0854cb34bdce Jul 03 14:00:42 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:43 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9e4431f9-7919-4f72-a331-0854cb34bdce" returned: 0 in 1.176s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] Lock "cinder-quobyte-9e4431f9-7919-4f72-a331-0854cb34bdce" released by "delete_volume" :: held 2.643s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:43 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] Created reservations ['f8fa0563-09b7-4f0a-93e6-354eb9e02163', '8daf62c8-cf10-40b1-9d0a-98caa320abb5', '5fd5c516-945d-4db8-85f7-ea1f1e32d626', '1052eb9a-67d2-40b1-9732-7da05d29daae'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:43 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65" returned: 0 in 1.736s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:43 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:00:43 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65 is being set with open permissions: ugo+rw Jul 03 14:00:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:43 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:43 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65 Jul 03 14:00:43 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:44 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.164s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:44 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:00:44 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] Deleted volume successfully. Jul 03 14:00:44 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6bca8a05-5ff1-42f1-99ee-d0b879703b67 tempest-VolumesListTestJSON-363576687 None] Lock "cinder-9e4431f9-7919-4f72-a331-0854cb34bdce-delete_volume" released by "delete_volume" :: held 4.474s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:45 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65" returned: 0 in 1.810s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:45 devstack sudo[95255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.info Jul 03 14:00:45 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:46 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:00:46 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Flow 'volume_create_manager' (2b1ef401-5607-45f6-bb0e-6ae7136c94e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:46 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f620a2-fca6-45db-bc6f-b9368db48820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:46 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f620a2-fca6-45db-bc6f-b9368db48820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-910960970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a11279-714a-46d5-85c8-9a31f323278b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a650748763941ee9e0f82cadb3b119c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:47Z,use_quota=True,user_id='d055578018ba4efd9ee2529b34c98468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:46 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76598801-d1b0-464f-b376-81b84ffc5091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:46 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76598801-d1b0-464f-b376-81b84ffc5091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:46 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f11aa8-fb65-4aba-b03b-b954dbc3c1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:46 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f11aa8-fb65-4aba-b03b-b954dbc3c1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69a11279-714a-46d5-85c8-9a31f323278b', 'volume_name': 'volume-69a11279-714a-46d5-85c8-9a31f323278b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:46 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e376a58-08c1-47ed-b056-b64ff81202ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:46 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e376a58-08c1-47ed-b056-b64ff81202ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:46 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d16154-a27c-4dff-9377-232267b6b094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:46 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Volume 69a11279-714a-46d5-85c8-9a31f323278b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69a11279-714a-46d5-85c8-9a31f323278b', 'volume_size': 1} Jul 03 14:00:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:46 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.info" returned: 0 in 1.316s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:46 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.info is being set with open permissions: ugo+rw Jul 03 14:00:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:46 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.info Jul 03 14:00:46 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:47 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.info" returned: 0 in 0.872s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.538s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.998s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-910960970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a11279-714a-46d5-85c8-9a31f323278b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a650748763941ee9e0f82cadb3b119c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:47Z,use_quota=True,user_id='d055578018ba4efd9ee2529b34c98468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:00:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Creating volume 69a11279-714a-46d5-85c8-9a31f323278b {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:00:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:00:47 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:00:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-69a11279-714a-46d5-85c8-9a31f323278b 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:47 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-69a11279-714a-46d5-85c8-9a31f323278b 1073741824 Jul 03 14:00:47 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:47 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-8846e474-38a5-4a72-a46c-4ce2b7263311 req-317442b5-2037-4a60-95f5-5308bf8c9046 tempest-VolumesSnapshotsTestJSON-653432432 None] Create snapshot completed successfully Jul 03 14:00:49 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] Acquiring lock "cinder-caa869ab-ebd4-46ca-b995-8a790cf02f65-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:49 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "cinder-caa869ab-ebd4-46ca-b995-8a790cf02f65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:49 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] Acquiring lock "cinder-quobyte-f14d9dc1-7530-447c-9b1e-a0d540e51c4f" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:49 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "cinder-quobyte-f14d9dc1-7530-447c-9b1e-a0d540e51c4f" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:49 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] Acquiring lock "cinder-quobyte-caa869ab-ebd4-46ca-b995-8a790cf02f65" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:49 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "cinder-quobyte-caa869ab-ebd4-46ca-b995-8a790cf02f65" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] Deleting offline snapshot caa869ab-ebd4-46ca-b995-8a790cf02f65 of volume f14d9dc1-7530-447c-9b1e-a0d540e51c4f {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:00:49 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] snapshot_file for this snap is: volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:00:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-69a11279-714a-46d5-85c8-9a31f323278b 1073741824" returned: 0 in 1.421s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:49 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2854cf-d00f-4021-adad-25a53337a29b]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-69a11279-714a-46d5-85c8-9a31f323278b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:49 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-69a11279-714a-46d5-85c8-9a31f323278b Jul 03 14:00:49 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:49 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65 Jul 03 14:00:49 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=80,cinder:SELECT=53,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=54,cinder:UPDATE=77,cinder:INSERT=15,cinder:DELETE=7 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Flow 'volume_create_manager' (02a12bca-e4a3-4ec1-a041-d63cdfc5870b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d5eb0d2-6c1a-4d34-b82f-e826e12d6f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d5eb0d2-6c1a-4d34-b82f-e826e12d6f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2104238324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7593ad796341b0924dc2435b5051df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:50Z,use_quota=True,user_id='517eb624fd55447e9b7fab034f2db6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc33662-b5fc-455b-ba9d-be0b0d9e4a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc33662-b5fc-455b-ba9d-be0b0d9e4a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbe96fa-8aa6-4d10-8701-54b7ceaa772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbe96fa-8aa6-4d10-8701-54b7ceaa772b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3', 'volume_name': 'volume-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06f732c-c9c8-4ecd-97b9-2254d65b1ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06f732c-c9c8-4ecd-97b9-2254d65b1ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50ad7b4-8f40-4503-a523-97e3bbc93ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:50 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Volume fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3', 'volume_size': 1} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:50 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65" returned: 0 in 1.199s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3dea57-8af1-4a0d-81b9-90fc511075fa]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:50 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-69a11279-714a-46d5-85c8-9a31f323278b" returned: 0 in 1.245s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] <== create_volume: return (2757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.759s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.310s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2104238324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7593ad796341b0924dc2435b5051df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:50Z,use_quota=True,user_id='517eb624fd55447e9b7fab034f2db6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Creating volume fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:00:50 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d16154-a27c-4dff-9377-232267b6b094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a11279-714a-46d5-85c8-9a31f323278b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2102efaa-2cce-4435-a25d-9eb2f990215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:50 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f Jul 03 14:00:50 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3 1073741824 Jul 03 14:00:50 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:50 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:50 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Volume volume-69a11279-714a-46d5-85c8-9a31f323278b (69a11279-714a-46d5-85c8-9a31f323278b): created successfully Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2102efaa-2cce-4435-a25d-9eb2f990215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Flow 'volume_create_manager' (2b1ef401-5607-45f6-bb0e-6ae7136c94e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:50 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-77fea83d-725f-428d-9d33-5dbe624781d0 tempest-VolumesActionsTest-501271827 None] Created volume successfully. Jul 03 14:00:51 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-75520e6e-6e34-4571-a217-135104e09631 tempest-VolumesActionsTest-501271827 None] Acquiring lock "cinder-69a11279-714a-46d5-85c8-9a31f323278b" by "attach_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:51 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-75520e6e-6e34-4571-a217-135104e09631 tempest-VolumesActionsTest-501271827 None] Lock "cinder-69a11279-714a-46d5-85c8-9a31f323278b" acquired by "attach_volume" :: waited 0.033s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:51 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-75520e6e-6e34-4571-a217-135104e09631 tempest-VolumesActionsTest-501271827 None] Attaching volume 69a11279-714a-46d5-85c8-9a31f323278b to instance 7208f4ae-fe67-4f1b-b8e1-262bc50edb4f at mountpoint /dev/vdb on host None. Jul 03 14:00:51 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-75520e6e-6e34-4571-a217-135104e09631 tempest-VolumesActionsTest-501271827 None] Attach volume completed successfully. Jul 03 14:00:51 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-75520e6e-6e34-4571-a217-135104e09631 tempest-VolumesActionsTest-501271827 None] Lock "cinder-69a11279-714a-46d5-85c8-9a31f323278b" released by "attach_volume" :: held 0.270s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:51 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f" returned: 0 in 1.033s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:51 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65 Jul 03 14:00:51 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:52 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3 1073741824" returned: 0 in 1.481s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:52 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3 Jul 03 14:00:52 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:52 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-67041310-6fe5-41c9-ae6f-270602b16f2d tempest-VolumesActionsTest-1261350471 None] Terminate volume connection completed successfully. Jul 03 14:00:52 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65" returned: 0 in 1.142s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:52 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65 Jul 03 14:00:52 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:52 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67041310-6fe5-41c9-ae6f-270602b16f2d tempest-VolumesActionsTest-1261350471 None] Acquiring lock "cinder-69a11279-714a-46d5-85c8-9a31f323278b-detach_volume" by "detach_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3" returned: 0 in 0.889s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] <== create_volume: return (2465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.470s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67041310-6fe5-41c9-ae6f-270602b16f2d tempest-VolumesActionsTest-1261350471 None] Lock "cinder-69a11279-714a-46d5-85c8-9a31f323278b-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50ad7b4-8f40-4503-a523-97e3bbc93ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9532591d-1e79-45e7-bb7a-67dcc2a7d2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:53 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Volume volume-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3 (fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3): created successfully Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9532591d-1e79-45e7-bb7a-67dcc2a7d2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Flow 'volume_create_manager' (02a12bca-e4a3-4ec1-a041-d63cdfc5870b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:53 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-67041310-6fe5-41c9-ae6f-270602b16f2d tempest-VolumesActionsTest-1261350471 None] Detaching volume 69a11279-714a-46d5-85c8-9a31f323278b from instance 7208f4ae-fe67-4f1b-b8e1-262bc50edb4f. Jul 03 14:00:53 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-843a3619-9cd7-4013-b41b-9f96f1dc134f tempest-VolumesNegativeTest-1558832984 None] Created volume successfully. Jul 03 14:00:53 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-67041310-6fe5-41c9-ae6f-270602b16f2d tempest-VolumesActionsTest-1261350471 None] Detach volume completed successfully. Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67041310-6fe5-41c9-ae6f-270602b16f2d tempest-VolumesActionsTest-1261350471 None] Lock "cinder-69a11279-714a-46d5-85c8-9a31f323278b-detach_volume" released by "detach_volume" :: held 0.131s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:53 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f.caa869ab-ebd4-46ca-b995-8a790cf02f65" returned: 0 in 0.747s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "cinder-quobyte-caa869ab-ebd4-46ca-b995-8a790cf02f65" released by "_delete_snapshot" :: held 4.287s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "cinder-quobyte-f14d9dc1-7530-447c-9b1e-a0d540e51c4f" released by "delete_snapshot" :: held 4.325s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.quota [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] Created reservations ['5cf79971-150c-4864-be2e-e80e65506710', 'd89238bf-5445-4b50-b3d4-5f114ef9ce0c', 'd76c4035-ba68-4cc4-a595-6d64f75c8ea9', 'ef7f689a-f3fe-46d1-9f8b-087733f17fde'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:53 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] Delete snapshot completed successfully. Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-6f642e56-f061-42be-a588-ad0430d7c18c req-4d9e2959-8d64-4c3c-818d-c20ce91e1825 tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "cinder-caa869ab-ebd4-46ca-b995-8a790cf02f65-delete_snapshot" released by "delete_snapshot" :: held 4.512s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] Acquiring lock "cinder-f14d9dc1-7530-447c-9b1e-a0d540e51c4f-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-49dd46ca-3c10-4961-9ba9-bd520fdf4cb7 tempest-VolumesActionsTest-501271827 None] Acquiring lock "cinder-69a11279-714a-46d5-85c8-9a31f323278b-detach_volume" by "detach_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "cinder-f14d9dc1-7530-447c-9b1e-a0d540e51c4f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-49dd46ca-3c10-4961-9ba9-bd520fdf4cb7 tempest-VolumesActionsTest-501271827 None] Lock "cinder-69a11279-714a-46d5-85c8-9a31f323278b-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:53 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-49dd46ca-3c10-4961-9ba9-bd520fdf4cb7 tempest-VolumesActionsTest-501271827 None] Volume detach called, but volume not attached. Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-49dd46ca-3c10-4961-9ba9-bd520fdf4cb7 tempest-VolumesActionsTest-501271827 None] Lock "cinder-69a11279-714a-46d5-85c8-9a31f323278b-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] Acquiring lock "cinder-quobyte-f14d9dc1-7530-447c-9b1e-a0d540e51c4f" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "cinder-quobyte-f14d9dc1-7530-447c-9b1e-a0d540e51c4f" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dbefa2-f7d5-4af1-9bea-daec5acc859c]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:53 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f Jul 03 14:00:53 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:54 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] Acquiring lock "cinder-69a11279-714a-46d5-85c8-9a31f323278b-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:54 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] Lock "cinder-69a11279-714a-46d5-85c8-9a31f323278b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:54 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] Acquiring lock "cinder-quobyte-69a11279-714a-46d5-85c8-9a31f323278b" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:54 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] Lock "cinder-quobyte-69a11279-714a-46d5-85c8-9a31f323278b" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:54 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d447ad-33fc-4b4e-a1ab-269ffb6a6c6c]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-69a11279-714a-46d5-85c8-9a31f323278b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:54 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f" returned: 0 in 1.026s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:54 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-69a11279-714a-46d5-85c8-9a31f323278b Jul 03 14:00:54 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:54 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f Jul 03 14:00:54 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:55 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-69a11279-714a-46d5-85c8-9a31f323278b" returned: 0 in 1.152s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-69a11279-714a-46d5-85c8-9a31f323278b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:55 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-69a11279-714a-46d5-85c8-9a31f323278b Jul 03 14:00:55 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:55 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f14d9dc1-7530-447c-9b1e-a0d540e51c4f" returned: 0 in 1.100s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "cinder-quobyte-f14d9dc1-7530-447c-9b1e-a0d540e51c4f" released by "delete_volume" :: held 2.205s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:56 devstack cinder-volume[86805]: DEBUG cinder.quota [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] Created reservations ['5caf3789-4b41-4a1b-a96b-410b3c14fb2c', '9da97e80-a10b-44f3-8f54-56ab21923770', '1a35b3d8-ac42-46f8-81f2-4fd1208bd303', 'f5665378-d662-4ad7-b023-77397be7c501'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:56 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:00:56 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:56 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-69a11279-714a-46d5-85c8-9a31f323278b" returned: 0 in 0.892s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] Lock "cinder-quobyte-69a11279-714a-46d5-85c8-9a31f323278b" released by "delete_volume" :: held 2.109s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:56 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] Created reservations ['27e5446a-dfe2-4478-ac14-c7c8f0550df1', '5907801f-e457-46b1-b17b-1358cf989a27', '670b8b22-6804-4f91-baf1-eefaed750efc', 'a3ed3808-b7dc-4ea1-b438-c61740dd519d'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:56 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:00:56 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:57 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.780s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:57 devstack cinder-volume[86805]: DEBUG cinder.manager [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:00:57 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] Deleted volume successfully. Jul 03 14:00:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-b0d8f515-0c6b-4000-a50b-62993ebfe3f1 req-3699f34c-2f6b-4f11-8e88-c25d0b315f05 tempest-VolumesSnapshotsTestJSON-653432432 None] Lock "cinder-f14d9dc1-7530-447c-9b1e-a0d540e51c4f-delete_volume" released by "delete_volume" :: held 3.324s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:57 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.774s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:57 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:00:57 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] Deleted volume successfully. Jul 03 14:00:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bb55f72d-3dd3-482a-ab1e-b0295c14d36c tempest-VolumesActionsTest-501271827 None] Lock "cinder-69a11279-714a-46d5-85c8-9a31f323278b-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:00:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:58 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:00:58 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:59 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.153s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Flow 'volume_create_manager' (ddb3f394-1f3a-49f8-aad8-e1f77b3213fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb27676-c60d-454e-bf11-7116a17029e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb27676-c60d-454e-bf11-7116a17029e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-87698237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4d792b-2e99-473d-835c-92c6ecb74c28,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e62b2eb28174e9e8c647017c1e942d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:02Z,use_quota=True,user_id='2f38547bed3c41dfb9181d568a675446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24da780d-658e-453d-a457-04879ac5db3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24da780d-658e-453d-a457-04879ac5db3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f434622-f7d7-43cf-b526-18909057a37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f434622-f7d7-43cf-b526-18909057a37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a4d792b-2e99-473d-835c-92c6ecb74c28', 'volume_name': 'volume-1a4d792b-2e99-473d-835c-92c6ecb74c28', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56cb7e6-91d8-46da-8707-43533348adaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56cb7e6-91d8-46da-8707-43533348adaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd75ff6-9e21-4fba-bca2-99358cfb2aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:02 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Volume 1a4d792b-2e99-473d-835c-92c6ecb74c28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a4d792b-2e99-473d-835c-92c6ecb74c28', 'volume_size': 1} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-87698237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4d792b-2e99-473d-835c-92c6ecb74c28,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e62b2eb28174e9e8c647017c1e942d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:02Z,use_quota=True,user_id='2f38547bed3c41dfb9181d568a675446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Creating volume 1a4d792b-2e99-473d-835c-92c6ecb74c28 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:01:02 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:01:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1a4d792b-2e99-473d-835c-92c6ecb74c28 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:02 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1a4d792b-2e99-473d-835c-92c6ecb74c28 1073741824 Jul 03 14:01:02 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:03 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1a4d792b-2e99-473d-835c-92c6ecb74c28 1073741824" returned: 0 in 1.017s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1a4d792b-2e99-473d-835c-92c6ecb74c28 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:03 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1a4d792b-2e99-473d-835c-92c6ecb74c28 Jul 03 14:01:03 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:04 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1a4d792b-2e99-473d-835c-92c6ecb74c28" returned: 0 in 0.815s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd75ff6-9e21-4fba-bca2-99358cfb2aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a4d792b-2e99-473d-835c-92c6ecb74c28', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046bdf87-9b27-409d-84a3-dfaa64bee050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:04 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Volume volume-1a4d792b-2e99-473d-835c-92c6ecb74c28 (1a4d792b-2e99-473d-835c-92c6ecb74c28): created successfully Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046bdf87-9b27-409d-84a3-dfaa64bee050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Flow 'volume_create_manager' (ddb3f394-1f3a-49f8-aad8-e1f77b3213fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:04 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-da58743e-463d-40e6-af5a-96ff0e7aa29f req-5b298625-b9d3-4896-8d80-395ee7fc36ec tempest-VolumesGetTestJSON-10798208 None] Created volume successfully. Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Flow 'volume_create_manager' (e86c7dce-e0b8-4c3f-ae97-a42ec8ff56e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f639175-cf89-42b6-8099-842d7f40c235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f639175-cf89-42b6-8099-842d7f40c235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-451092481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43636d8c-996d-4c4e-91aa-a478eb1d91ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f7c64c2f1244e0b299bff38cb5ce26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:04Z,use_quota=True,user_id='b0b7b30a755e4d18bc8b60fcc3a0b35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73090ee7-30ad-4971-9a58-874a35173245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73090ee7-30ad-4971-9a58-874a35173245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcb10db-4819-4289-8ff3-e5ab2802ac9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcb10db-4819-4289-8ff3-e5ab2802ac9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43636d8c-996d-4c4e-91aa-a478eb1d91ab', 'volume_name': 'volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468b956d-c037-4b9e-8640-a382a2149e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468b956d-c037-4b9e-8640-a382a2149e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a81e78c-05ff-4bf7-808b-8ae650afb63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:04 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Volume 43636d8c-996d-4c4e-91aa-a478eb1d91ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab', 'volume_size': 1} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-451092481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43636d8c-996d-4c4e-91aa-a478eb1d91ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f7c64c2f1244e0b299bff38cb5ce26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:04Z,use_quota=True,user_id='b0b7b30a755e4d18bc8b60fcc3a0b35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Creating volume 43636d8c-996d-4c4e-91aa-a478eb1d91ab {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:01:04 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:04 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab 1073741824 Jul 03 14:01:04 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] Acquiring lock "cinder-1a4d792b-2e99-473d-835c-92c6ecb74c28-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] Lock "cinder-1a4d792b-2e99-473d-835c-92c6ecb74c28-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] Acquiring lock "cinder-quobyte-1a4d792b-2e99-473d-835c-92c6ecb74c28" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] Lock "cinder-quobyte-1a4d792b-2e99-473d-835c-92c6ecb74c28" acquired by "delete_volume" :: waited 0.030s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25f726f-4e25-4cef-a6a0-aa6df81998ee]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1a4d792b-2e99-473d-835c-92c6ecb74c28 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:05 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1a4d792b-2e99-473d-835c-92c6ecb74c28 Jul 03 14:01:05 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:05 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:01:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Flow 'volume_create_manager' (78cb39bd-c792-42fd-9162-6c6ac024ae7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0f6e96-d347-41f9-82c5-e7884ec83c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0f6e96-d347-41f9-82c5-e7884ec83c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-521165980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95752175-9e1d-469c-864e-45757b9429eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a650748763941ee9e0f82cadb3b119c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:05Z,use_quota=True,user_id='d055578018ba4efd9ee2529b34c98468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed14278f-e9a0-489c-a108-80fb53d2ae3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed14278f-e9a0-489c-a108-80fb53d2ae3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf561883-abc9-4393-825a-082264f4e8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf561883-abc9-4393-825a-082264f4e8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95752175-9e1d-469c-864e-45757b9429eb', 'volume_name': 'volume-95752175-9e1d-469c-864e-45757b9429eb', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c3dad6-ea59-4cda-9df5-5da5d1314506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c3dad6-ea59-4cda-9df5-5da5d1314506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f8d9c9-cbb5-49a8-9a5c-0037e85136fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:05 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Volume 95752175-9e1d-469c-864e-45757b9429eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95752175-9e1d-469c-864e-45757b9429eb', 'volume_size': 1} Jul 03 14:01:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:05 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab 1073741824" returned: 0 in 1.007s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:05 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab Jul 03 14:01:05 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:05 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1a4d792b-2e99-473d-835c-92c6ecb74c28" returned: 0 in 0.952s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1a4d792b-2e99-473d-835c-92c6ecb74c28 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:05 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1a4d792b-2e99-473d-835c-92c6ecb74c28 Jul 03 14:01:05 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:06 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab" returned: 0 in 0.733s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.881s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-521165980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95752175-9e1d-469c-864e-45757b9429eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a650748763941ee9e0f82cadb3b119c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:05Z,use_quota=True,user_id='d055578018ba4efd9ee2529b34c98468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Creating volume 95752175-9e1d-469c-864e-45757b9429eb {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:01:06 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-95752175-9e1d-469c-864e-45757b9429eb 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:06 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-95752175-9e1d-469c-864e-45757b9429eb 1073741824 Jul 03 14:01:06 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a81e78c-05ff-4bf7-808b-8ae650afb63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77050134-424d-4e57-80bb-9d406b194462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:06 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Volume volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab (43636d8c-996d-4c4e-91aa-a478eb1d91ab): created successfully Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77050134-424d-4e57-80bb-9d406b194462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Flow 'volume_create_manager' (e86c7dce-e0b8-4c3f-ae97-a42ec8ff56e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:06 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-01c47a08-af73-4d39-bd1a-e4ec90d84c27 tempest-AttachVolumeNegativeTest-1388742330 None] Created volume successfully. Jul 03 14:01:06 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1a4d792b-2e99-473d-835c-92c6ecb74c28" returned: 0 in 0.766s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] Lock "cinder-quobyte-1a4d792b-2e99-473d-835c-92c6ecb74c28" released by "delete_volume" :: held 1.789s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG cinder.quota [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] Created reservations ['eeab1164-80ff-4c64-be12-b46e1bc4fddd', '744fbf30-0c69-4034-92e8-f9528439a2fe', 'bd717a2c-f1fd-41c4-9e88-f776896907a0', 'c2aa3bba-53d2-4feb-a8c4-1fc1623d88ba'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:06 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:01:06 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:07 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-95752175-9e1d-469c-864e-45757b9429eb 1073741824" returned: 0 in 0.940s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-95752175-9e1d-469c-864e-45757b9429eb {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:07 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-95752175-9e1d-469c-864e-45757b9429eb Jul 03 14:01:07 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:07 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.867s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:07 devstack cinder-volume[86805]: DEBUG cinder.manager [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:07 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] Deleted volume successfully. Jul 03 14:01:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-e0bf3583-6468-4982-bf87-f45b732b704b req-084a145a-35db-4c3a-a789-05fa88a6e6e6 tempest-VolumesGetTestJSON-10798208 None] Lock "cinder-1a4d792b-2e99-473d-835c-92c6ecb74c28-delete_volume" released by "delete_volume" :: held 2.932s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:08 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-95752175-9e1d-469c-864e-45757b9429eb" returned: 0 in 0.792s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:01:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f8d9c9-cbb5-49a8-9a5c-0037e85136fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95752175-9e1d-469c-864e-45757b9429eb', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519f7807-687f-48c0-8add-2e9cb4171d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:08 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Volume volume-95752175-9e1d-469c-864e-45757b9429eb (95752175-9e1d-469c-864e-45757b9429eb): created successfully Jul 03 14:01:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519f7807-687f-48c0-8add-2e9cb4171d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Flow 'volume_create_manager' (78cb39bd-c792-42fd-9162-6c6ac024ae7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:08 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ab9616ad-3103-4265-9d30-b437e63e321f tempest-VolumesActionsTest-501271827 None] Created volume successfully. Jul 03 14:01:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] Acquiring lock "cinder-95752175-9e1d-469c-864e-45757b9429eb-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] Lock "cinder-95752175-9e1d-469c-864e-45757b9429eb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] Acquiring lock "cinder-quobyte-95752175-9e1d-469c-864e-45757b9429eb" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] Lock "cinder-quobyte-95752175-9e1d-469c-864e-45757b9429eb" acquired by "delete_volume" :: waited 0.028s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:08 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2541c31f-1649-48df-a92e-2e339f567b9c]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-95752175-9e1d-469c-864e-45757b9429eb {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:08 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-95752175-9e1d-469c-864e-45757b9429eb Jul 03 14:01:08 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:09 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-95752175-9e1d-469c-864e-45757b9429eb" returned: 0 in 0.947s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-95752175-9e1d-469c-864e-45757b9429eb {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:09 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-95752175-9e1d-469c-864e-45757b9429eb Jul 03 14:01:09 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:10 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-95752175-9e1d-469c-864e-45757b9429eb" returned: 0 in 1.146s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] Lock "cinder-quobyte-95752175-9e1d-469c-864e-45757b9429eb" released by "delete_volume" :: held 2.188s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:11 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] Created reservations ['a68c1a01-a70e-42ac-b4d5-2a7361da9336', 'c9bbb71b-17af-4752-be22-bd2022ba3592', '13449a0c-a1d7-47e5-8748-fd2006b4731e', '02e4dd95-0995-46c9-a87d-85bcd568586d'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:11 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:01:11 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-8e015604-2221-4630-9725-acfccf9d67a3 req-16c4c822-e945-4339-aef7-63841cbce015 tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-8e015604-2221-4630-9725-acfccf9d67a3 req-16c4c822-e945-4339-aef7-63841cbce015 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:11 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[296dd196-b49c-46fa-ad17-a9d22b58bd61]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-8e015604-2221-4630-9725-acfccf9d67a3 req-16c4c822-e945-4339-aef7-63841cbce015 tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:12 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab Jul 03 14:01:12 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:12 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.118s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:12 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:12 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] Deleted volume successfully. Jul 03 14:01:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7e38558c-0da8-4245-8092-ecd6ffe8a43a tempest-VolumesActionsTest-1261350471 None] Lock "cinder-95752175-9e1d-469c-864e-45757b9429eb-delete_volume" released by "delete_volume" :: held 3.660s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Flow 'volume_create_manager' (06cf1821-e903-4c66-92fe-f5054ff89b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c4cf0c-580c-48ba-a6fa-062fccee92e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c4cf0c-580c-48ba-a6fa-062fccee92e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1120937156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08684668-3a5a-4a70-8b45-d1266b0033ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a650748763941ee9e0f82cadb3b119c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:13Z,use_quota=True,user_id='d055578018ba4efd9ee2529b34c98468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715f7a4b-eda7-469f-bd67-63e68a98af3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715f7a4b-eda7-469f-bd67-63e68a98af3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42148e28-c1f4-4dc6-a382-5a13cbbf2d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42148e28-c1f4-4dc6-a382-5a13cbbf2d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08684668-3a5a-4a70-8b45-d1266b0033ef', 'volume_name': 'volume-08684668-3a5a-4a70-8b45-d1266b0033ef', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb57f857-9bdb-47ef-ac9c-272f2e87f0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb57f857-9bdb-47ef-ac9c-272f2e87f0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7117a4-c785-4ce6-b659-c9d09b3bb6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:13 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Volume 08684668-3a5a-4a70-8b45-d1266b0033ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08684668-3a5a-4a70-8b45-d1266b0033ef', 'volume_size': 1} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:13 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-8e015604-2221-4630-9725-acfccf9d67a3 req-16c4c822-e945-4339-aef7-63841cbce015 tempest-AttachVolumeNegativeTest-1388742330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab" returned: 0 in 1.516s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-8e015604-2221-4630-9725-acfccf9d67a3 req-16c4c822-e945-4339-aef7-63841cbce015 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.545s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.183s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1120937156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08684668-3a5a-4a70-8b45-d1266b0033ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a650748763941ee9e0f82cadb3b119c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:13Z,use_quota=True,user_id='d055578018ba4efd9ee2529b34c98468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Creating volume 08684668-3a5a-4a70-8b45-d1266b0033ef {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:01:13 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-08684668-3a5a-4a70-8b45-d1266b0033ef 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:13 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-08684668-3a5a-4a70-8b45-d1266b0033ef 1073741824 Jul 03 14:01:13 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-8e015604-2221-4630-9725-acfccf9d67a3 req-16c4c822-e945-4339-aef7-63841cbce015 tempest-AttachVolumeNegativeTest-1388742330 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45e07279-f933-4bb1-a39c-84bdd671835f', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:01:13 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-8e015604-2221-4630-9725-acfccf9d67a3 req-16c4c822-e945-4339-aef7-63841cbce015 tempest-AttachVolumeNegativeTest-1388742330 None] attachment_update completed successfully. Jul 03 14:01:14 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-08684668-3a5a-4a70-8b45-d1266b0033ef 1073741824" returned: 0 in 1.446s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-08684668-3a5a-4a70-8b45-d1266b0033ef {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:14 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-08684668-3a5a-4a70-8b45-d1266b0033ef Jul 03 14:01:14 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:15 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-08684668-3a5a-4a70-8b45-d1266b0033ef" returned: 0 in 1.091s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] <== create_volume: return (2595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:01:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.601s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7117a4-c785-4ce6-b659-c9d09b3bb6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08684668-3a5a-4a70-8b45-d1266b0033ef', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5089298a-5845-4b41-851a-bc003584e4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:16 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Volume volume-08684668-3a5a-4a70-8b45-d1266b0033ef (08684668-3a5a-4a70-8b45-d1266b0033ef): created successfully Jul 03 14:01:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5089298a-5845-4b41-851a-bc003584e4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Flow 'volume_create_manager' (06cf1821-e903-4c66-92fe-f5054ff89b97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:16 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e6177267-87da-4750-9e7b-e1b6d8c3ea6a tempest-VolumesActionsTest-501271827 None] Created volume successfully. Jul 03 14:01:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] Acquiring lock "cinder-08684668-3a5a-4a70-8b45-d1266b0033ef-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] Lock "cinder-08684668-3a5a-4a70-8b45-d1266b0033ef-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] Acquiring lock "cinder-quobyte-08684668-3a5a-4a70-8b45-d1266b0033ef" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] Lock "cinder-quobyte-08684668-3a5a-4a70-8b45-d1266b0033ef" acquired by "delete_volume" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:16 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0662468a-bef6-4a85-828f-ce1052b173d7]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-08684668-3a5a-4a70-8b45-d1266b0033ef {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:16 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-08684668-3a5a-4a70-8b45-d1266b0033ef Jul 03 14:01:16 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:17 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-08684668-3a5a-4a70-8b45-d1266b0033ef" returned: 0 in 0.850s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-08684668-3a5a-4a70-8b45-d1266b0033ef {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:17 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-08684668-3a5a-4a70-8b45-d1266b0033ef Jul 03 14:01:17 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:18 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-08684668-3a5a-4a70-8b45-d1266b0033ef" returned: 0 in 0.654s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] Lock "cinder-quobyte-08684668-3a5a-4a70-8b45-d1266b0033ef" released by "delete_volume" :: held 1.557s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:18 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] Created reservations ['d4566d1c-a3e3-4276-b3f2-1f41a1478f65', '48bdde4f-6e82-49c4-a4fe-113f57354408', '98912c80-58d7-488d-b762-a1612268900a', '77377c84-d90d-4812-9bf6-a469ef0db952'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-090f66e3-1c06-4ce9-add9-288314303478 tempest-BackendsCapabilitiesAdminTestsJSON-1168113627 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7272872924805, 'free_capacity_gb': 1775.7272872924805, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86805) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 14:01:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:18 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:01:18 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dccbab86-bf36-4fe0-b325-587d931e938f tempest-BackendsCapabilitiesAdminTestsJSON-1168113627 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7272872924805, 'free_capacity_gb': 1775.7272872924805, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86805) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 14:01:19 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.679s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:19 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] Deleted volume successfully. Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4010972e-76c7-4e51-afa1-0186cd727e6c tempest-VolumesActionsTest-1261350471 None] Lock "cinder-08684668-3a5a-4a70-8b45-d1266b0033ef-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Flow 'volume_create_manager' (2d5270c0-7adf-41b3-a731-bf8c37bdbba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51c0797-79ba-496a-8a42-99321dd54fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51c0797-79ba-496a-8a42-99321dd54fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-367579597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb61d89-dcc0-4c09-a333-fb3790879b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a650748763941ee9e0f82cadb3b119c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:19Z,use_quota=True,user_id='d055578018ba4efd9ee2529b34c98468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72882d8-6240-4047-8f51-ed78be600d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72882d8-6240-4047-8f51-ed78be600d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6673698-5d6f-490f-9cc4-a2a97504e059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6673698-5d6f-490f-9cc4-a2a97504e059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb61d89-dcc0-4c09-a333-fb3790879b19', 'volume_name': 'volume-deb61d89-dcc0-4c09-a333-fb3790879b19', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92dfe040-38ed-4fa8-ad7b-e096d814073f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92dfe040-38ed-4fa8-ad7b-e096d814073f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b21cdc-db88-4166-8b6f-cd938a8c3160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:19 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Volume deb61d89-dcc0-4c09-a333-fb3790879b19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb61d89-dcc0-4c09-a333-fb3790879b19', 'volume_size': 1} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-367579597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb61d89-dcc0-4c09-a333-fb3790879b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a650748763941ee9e0f82cadb3b119c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:19Z,use_quota=True,user_id='d055578018ba4efd9ee2529b34c98468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Creating volume deb61d89-dcc0-4c09-a333-fb3790879b19 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:01:19 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:01:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-deb61d89-dcc0-4c09-a333-fb3790879b19 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:19 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-deb61d89-dcc0-4c09-a333-fb3790879b19 1073741824 Jul 03 14:01:19 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:20 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-deb61d89-dcc0-4c09-a333-fb3790879b19 1073741824" returned: 0 in 1.036s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-deb61d89-dcc0-4c09-a333-fb3790879b19 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:20 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-deb61d89-dcc0-4c09-a333-fb3790879b19 Jul 03 14:01:20 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:20 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-d8dcc6b7-28b1-4170-a263-5896d453286c req-3f439d9e-0add-49a2-8d6a-2f0bfe6568a9 tempest-AttachVolumeNegativeTest-1388742330 None] Terminate volume connection completed successfully. Jul 03 14:01:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-d8dcc6b7-28b1-4170-a263-5896d453286c req-3f439d9e-0add-49a2-8d6a-2f0bfe6568a9 tempest-AttachVolumeNegativeTest-1388742330 None] Deleting attachment 45e07279-f933-4bb1-a39c-84bdd671835f. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:01:21 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-deb61d89-dcc0-4c09-a333-fb3790879b19" returned: 0 in 0.719s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:01:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b21cdc-db88-4166-8b6f-cd938a8c3160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb61d89-dcc0-4c09-a333-fb3790879b19', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c44102-5057-48ba-b909-9b0f18f7849b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:21 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Volume volume-deb61d89-dcc0-4c09-a333-fb3790879b19 (deb61d89-dcc0-4c09-a333-fb3790879b19): created successfully Jul 03 14:01:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c44102-5057-48ba-b909-9b0f18f7849b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Flow 'volume_create_manager' (2d5270c0-7adf-41b3-a731-bf8c37bdbba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:21 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-0af4d6cf-7c5f-4a92-8cc6-76d497f1e092 tempest-VolumesActionsTest-501271827 None] Created volume successfully. Jul 03 14:01:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] Acquiring lock "cinder-deb61d89-dcc0-4c09-a333-fb3790879b19-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] Lock "cinder-deb61d89-dcc0-4c09-a333-fb3790879b19-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] Acquiring lock "cinder-quobyte-deb61d89-dcc0-4c09-a333-fb3790879b19" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] Lock "cinder-quobyte-deb61d89-dcc0-4c09-a333-fb3790879b19" acquired by "delete_volume" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:21 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[370e6b6a-b87b-46be-8dab-5013f05977c9]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-deb61d89-dcc0-4c09-a333-fb3790879b19 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:22 devstack sudo[96107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-deb61d89-dcc0-4c09-a333-fb3790879b19 Jul 03 14:01:22 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:22 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-deb61d89-dcc0-4c09-a333-fb3790879b19" returned: 0 in 1.038s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-deb61d89-dcc0-4c09-a333-fb3790879b19 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:23 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-deb61d89-dcc0-4c09-a333-fb3790879b19 Jul 03 14:01:23 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:23 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-deb61d89-dcc0-4c09-a333-fb3790879b19" returned: 0 in 0.839s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] Lock "cinder-quobyte-deb61d89-dcc0-4c09-a333-fb3790879b19" released by "delete_volume" :: held 1.934s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:23 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] Created reservations ['51ba6d94-2c23-4580-b6e0-9282921e4610', '449af7f8-25a5-445a-83e4-4cfd771c418f', '085c1f19-29a2-4454-a1d1-aab6cb9439bc', '7d7d8f9c-cccf-4c7f-b057-b53c951e149e'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:24 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:01:24 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:25 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.645s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:25 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] Deleted volume successfully. Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Flow 'volume_create_manager' (df9a333d-66d9-41ad-b318-cc9c7877fcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e950b7b6-ed44-4f90-9f81-76a33d1143c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-80221264-0ef1-4b60-8321-6e8a58dc0e0b tempest-VolumesActionsTest-1261350471 None] Lock "cinder-deb61d89-dcc0-4c09-a333-fb3790879b19-delete_volume" released by "delete_volume" :: held 3.935s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e950b7b6-ed44-4f90-9f81-76a33d1143c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-975236047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6a739d-ba9d-4198-be75-1d015105f03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a650748763941ee9e0f82cadb3b119c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:26Z,use_quota=True,user_id='d055578018ba4efd9ee2529b34c98468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdcc6a17-4794-4937-8036-ab15917bba3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdcc6a17-4794-4937-8036-ab15917bba3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f832740a-c71d-4956-95aa-17f32a24eed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f832740a-c71d-4956-95aa-17f32a24eed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc6a739d-ba9d-4198-be75-1d015105f03f', 'volume_name': 'volume-dc6a739d-ba9d-4198-be75-1d015105f03f', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68381e02-9596-466a-bec7-68ac36b825ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68381e02-9596-466a-bec7-68ac36b825ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424e25e3-1d86-4b11-95de-0a4beb273d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:25 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Volume dc6a739d-ba9d-4198-be75-1d015105f03f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc6a739d-ba9d-4198-be75-1d015105f03f', 'volume_size': 1} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-975236047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6a739d-ba9d-4198-be75-1d015105f03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a650748763941ee9e0f82cadb3b119c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:26Z,use_quota=True,user_id='d055578018ba4efd9ee2529b34c98468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Creating volume dc6a739d-ba9d-4198-be75-1d015105f03f {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:01:25 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:01:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6a739d-ba9d-4198-be75-1d015105f03f 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:25 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6a739d-ba9d-4198-be75-1d015105f03f 1073741824 Jul 03 14:01:25 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:27 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6a739d-ba9d-4198-be75-1d015105f03f 1073741824" returned: 0 in 1.306s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6a739d-ba9d-4198-be75-1d015105f03f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:27 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6a739d-ba9d-4198-be75-1d015105f03f Jul 03 14:01:27 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:28 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6a739d-ba9d-4198-be75-1d015105f03f" returned: 0 in 0.978s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] <== create_volume: return (2354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:01:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.359s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424e25e3-1d86-4b11-95de-0a4beb273d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc6a739d-ba9d-4198-be75-1d015105f03f', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc94ca83-9931-4f2f-9c04-e8e81a006ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:28 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Volume volume-dc6a739d-ba9d-4198-be75-1d015105f03f (dc6a739d-ba9d-4198-be75-1d015105f03f): created successfully Jul 03 14:01:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc94ca83-9931-4f2f-9c04-e8e81a006ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Flow 'volume_create_manager' (df9a333d-66d9-41ad-b318-cc9c7877fcd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-35add96f-02fc-48d9-977f-b92863c9088e tempest-VolumesActionsTest-501271827 None] Created volume successfully. Jul 03 14:01:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] Acquiring lock "cinder-dc6a739d-ba9d-4198-be75-1d015105f03f-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] Lock "cinder-dc6a739d-ba9d-4198-be75-1d015105f03f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] Acquiring lock "cinder-quobyte-dc6a739d-ba9d-4198-be75-1d015105f03f" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] Lock "cinder-quobyte-dc6a739d-ba9d-4198-be75-1d015105f03f" acquired by "delete_volume" :: waited 0.028s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:29 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a70cc8b-14d3-4915-82ed-dd53430abc9f]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6a739d-ba9d-4198-be75-1d015105f03f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:29 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6a739d-ba9d-4198-be75-1d015105f03f Jul 03 14:01:29 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:30 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6a739d-ba9d-4198-be75-1d015105f03f" returned: 0 in 0.986s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6a739d-ba9d-4198-be75-1d015105f03f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:30 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6a739d-ba9d-4198-be75-1d015105f03f Jul 03 14:01:30 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:31 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6a739d-ba9d-4198-be75-1d015105f03f" returned: 0 in 0.829s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] Lock "cinder-quobyte-dc6a739d-ba9d-4198-be75-1d015105f03f" released by "delete_volume" :: held 1.891s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:31 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] Created reservations ['3be2ba58-1afd-40a6-9f9b-019fcaa13e69', 'b24f3eb4-d966-4dfa-ba7f-b8d69d4b3c74', '8c0ff6bd-baa9-4852-bd34-0cd525885f92', 'c8d7bf80-a512-448b-a3c2-ab10abc53e18'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:31 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:01:31 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] Acquiring lock "cinder-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] Lock "cinder-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] Acquiring lock "cinder-quobyte-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] Lock "cinder-quobyte-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3" acquired by "delete_volume" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[154ae17e-480d-472c-a0bd-e9e7244c0602]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:32 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.888s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:32 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] Deleted volume successfully. Jul 03 14:01:32 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3 Jul 03 14:01:32 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5aed196d-fc66-423b-aa9f-74e3052d93c1 tempest-VolumesActionsTest-1261350471 None] Lock "cinder-dc6a739d-ba9d-4198-be75-1d015105f03f-delete_volume" released by "delete_volume" :: held 3.127s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Flow 'volume_create_manager' (53858470-2678-4187-af11-5602e9768ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe17bb3-8c60-4cbb-be2a-5db721c92264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe17bb3-8c60-4cbb-be2a-5db721c92264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1528721962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f689a74-4f2b-4b1c-ae07-8d38656e5c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a650748763941ee9e0f82cadb3b119c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:32Z,use_quota=True,user_id='d055578018ba4efd9ee2529b34c98468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f61317-ed16-4c7c-9cd5-8e050212e1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f61317-ed16-4c7c-9cd5-8e050212e1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967bdca5-a51f-4283-b37d-2936c97f4421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967bdca5-a51f-4283-b37d-2936c97f4421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f689a74-4f2b-4b1c-ae07-8d38656e5c2d', 'volume_name': 'volume-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13cd1d0-6d55-44a7-96bd-b56041451306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13cd1d0-6d55-44a7-96bd-b56041451306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb85880-67e5-4593-8dbe-81157375b2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:32 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Volume 1f689a74-4f2b-4b1c-ae07-8d38656e5c2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d', 'volume_size': 1} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1528721962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f689a74-4f2b-4b1c-ae07-8d38656e5c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a650748763941ee9e0f82cadb3b119c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:32Z,use_quota=True,user_id='d055578018ba4efd9ee2529b34c98468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Creating volume 1f689a74-4f2b-4b1c-ae07-8d38656e5c2d {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:01:32 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:01:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:32 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d 1073741824 Jul 03 14:01:32 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:33 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3" returned: 0 in 1.097s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:33 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3 Jul 03 14:01:33 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:33 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d 1073741824" returned: 0 in 1.146s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:33 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d Jul 03 14:01:33 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:34 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3" returned: 0 in 0.927s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] Lock "cinder-quobyte-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3" released by "delete_volume" :: held 2.125s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e13fdbe0-bcaa-463e-9f8c-13c16b11b133 tempest-GroupsTest-400350059 None] Group tempest-Group1-514973860: creating Jul 03 14:01:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e13fdbe0-bcaa-463e-9f8c-13c16b11b133 tempest-GroupsTest-400350059 None] Group tempest-Group1-514973860: created successfully Jul 03 14:01:34 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] Created reservations ['d607c56f-0f5a-45cb-b35d-633f9c34917a', '54447b5e-886a-4677-9e6d-2e56b9cb946e', '83092b45-f3de-4eeb-a8cc-a81a27d0b1ad', 'ce42b441-3065-47fb-896d-29dd7b4269d2'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e13fdbe0-bcaa-463e-9f8c-13c16b11b133 tempest-GroupsTest-400350059 None] Create group completed successfully. Jul 03 14:01:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:34 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:01:34 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:34 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d" returned: 0 in 0.747s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:01:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb85880-67e5-4593-8dbe-81157375b2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71d90b9-1cc3-422b-b2af-4368a55219e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:34 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Volume volume-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d (1f689a74-4f2b-4b1c-ae07-8d38656e5c2d): created successfully Jul 03 14:01:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71d90b9-1cc3-422b-b2af-4368a55219e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Flow 'volume_create_manager' (53858470-2678-4187-af11-5602e9768ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-36a05d0c-24a4-4384-b9a1-4702e6727852 tempest-VolumesActionsTest-501271827 None] Created volume successfully. Jul 03 14:01:35 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.735s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:35 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:35 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] Deleted volume successfully. Jul 03 14:01:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e5a13ef4-d7b0-4c1b-b4d8-25fd5db1ccaf tempest-VolumesNegativeTest-1558832984 None] Lock "cinder-fcd0ff28-fe4b-41ee-a1b3-b4b549f134a3-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:35 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-3a6916a5-7b52-4a71-9adb-2f4d25b24ced tempest-GroupsTest-400350059 None] Group tempest-Group2-2000481009: creating Jul 03 14:01:35 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-3a6916a5-7b52-4a71-9adb-2f4d25b24ced tempest-GroupsTest-400350059 None] Group tempest-Group2-2000481009: created successfully Jul 03 14:01:35 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-3a6916a5-7b52-4a71-9adb-2f4d25b24ced tempest-GroupsTest-400350059 None] Create group completed successfully. Jul 03 14:01:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] Acquiring lock "cinder-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] Lock "cinder-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] Acquiring lock "cinder-quobyte-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] Lock "cinder-quobyte-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d" acquired by "delete_volume" :: waited 0.029s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:36 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fe5790-96c8-4f4e-a3a5-39318f88adec]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:36 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d Jul 03 14:01:36 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Flow 'volume_create_manager' (7a52f7d6-76ce-4ad9-ac40-08fb9b7dcc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c381741-1b11-4bbb-97d4-a5b52d3789f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c381741-1b11-4bbb-97d4-a5b52d3789f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1300154199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9d295f2d-ad4e-4c17-a5c8-8b7b08392f0b,host='devstack@QuobyteHD#QuobyteHD',id=233783e4-8d64-4fd1-a9e0-7d5e6996f517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c956e161e8341b481d32670cc48151a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:37Z,use_quota=True,user_id='b844d64028af455486556b7ccea82bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3884b436-eead-4f3b-a0c8-82d923f466aa),volume_type_id=3884b436-eead-4f3b-a0c8-82d923f466aa)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9dcf647-b631-48a1-b59a-1fcd0898c920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9dcf647-b631-48a1-b59a-1fcd0898c920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9e8163-dc95-4b1d-93ff-31e9ae01da03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9e8163-dc95-4b1d-93ff-31e9ae01da03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '233783e4-8d64-4fd1-a9e0-7d5e6996f517', 'volume_name': 'volume-233783e4-8d64-4fd1-a9e0-7d5e6996f517', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14150a1-627c-4f77-97f0-f0a76b0bc244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14150a1-627c-4f77-97f0-f0a76b0bc244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fd7492-4d26-4485-8df3-2b5d2c7fb61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:37 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Volume 233783e4-8d64-4fd1-a9e0-7d5e6996f517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-233783e4-8d64-4fd1-a9e0-7d5e6996f517', 'volume_size': 1} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9d295f2d-ad4e-4c17-a5c8-8b7b08392f0b,created_at=2026-07-03T12:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1300154199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9d295f2d-ad4e-4c17-a5c8-8b7b08392f0b,host='devstack@QuobyteHD#QuobyteHD',id=233783e4-8d64-4fd1-a9e0-7d5e6996f517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c956e161e8341b481d32670cc48151a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:37Z,use_quota=True,user_id='b844d64028af455486556b7ccea82bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3884b436-eead-4f3b-a0c8-82d923f466aa),volume_type_id=3884b436-eead-4f3b-a0c8-82d923f466aa)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Creating volume 233783e4-8d64-4fd1-a9e0-7d5e6996f517 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:01:37 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-233783e4-8d64-4fd1-a9e0-7d5e6996f517 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:37 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-233783e4-8d64-4fd1-a9e0-7d5e6996f517 1073741824 Jul 03 14:01:37 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:37 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d" returned: 0 in 0.989s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:37 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d Jul 03 14:01:37 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:38 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d" returned: 0 in 0.833s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] Lock "cinder-quobyte-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d" released by "delete_volume" :: held 1.909s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:38 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-233783e4-8d64-4fd1-a9e0-7d5e6996f517 1073741824" returned: 0 in 1.035s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:38 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] Created reservations ['6912b657-f7cc-42cc-b0c6-5ab94b1c8947', '28fadac4-7a73-4072-bffe-eeef909b6f3e', '862a47cd-80ef-4b33-9149-64f4b93dcd46', 'e77fa73b-9061-4b32-a278-759cd5cf7e54'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-233783e4-8d64-4fd1-a9e0-7d5e6996f517 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:38 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-233783e4-8d64-4fd1-a9e0-7d5e6996f517 Jul 03 14:01:38 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:38 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:01:38 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:39 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.819s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:39 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:39 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] Deleted volume successfully. Jul 03 14:01:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-25a04112-ad65-427a-9638-fd152b59921d tempest-VolumesActionsTest-501271827 None] Lock "cinder-1f689a74-4f2b-4b1c-ae07-8d38656e5c2d-delete_volume" released by "delete_volume" :: held 3.195s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:39 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-233783e4-8d64-4fd1-a9e0-7d5e6996f517" returned: 0 in 1.152s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] <== create_volume: return (2280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:01:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.283s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fd7492-4d26-4485-8df3-2b5d2c7fb61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-233783e4-8d64-4fd1-a9e0-7d5e6996f517', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbf7ca1-0d9c-499f-9e2f-36893d080f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:39 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Volume volume-233783e4-8d64-4fd1-a9e0-7d5e6996f517 (233783e4-8d64-4fd1-a9e0-7d5e6996f517): created successfully Jul 03 14:01:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbf7ca1-0d9c-499f-9e2f-36893d080f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Flow 'volume_create_manager' (7a52f7d6-76ce-4ad9-ac40-08fb9b7dcc46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:39 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-255e2e24-9a35-45d7-9ea1-2e84243e3f8f tempest-GroupsTest-400350059 None] Created volume successfully. Jul 03 14:01:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] Acquiring lock "cinder-quobyte-233783e4-8d64-4fd1-a9e0-7d5e6996f517" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] Lock "cinder-quobyte-233783e4-8d64-4fd1-a9e0-7d5e6996f517" acquired by "delete_volume" :: waited 0.027s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:40 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ffb464-5db7-44a4-8e76-719290843651]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-233783e4-8d64-4fd1-a9e0-7d5e6996f517 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:40 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-233783e4-8d64-4fd1-a9e0-7d5e6996f517 Jul 03 14:01:40 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:41 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-233783e4-8d64-4fd1-a9e0-7d5e6996f517" returned: 0 in 0.850s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-233783e4-8d64-4fd1-a9e0-7d5e6996f517 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:41 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-233783e4-8d64-4fd1-a9e0-7d5e6996f517 Jul 03 14:01:41 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:42 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-233783e4-8d64-4fd1-a9e0-7d5e6996f517" returned: 0 in 0.920s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] Lock "cinder-quobyte-233783e4-8d64-4fd1-a9e0-7d5e6996f517" released by "delete_volume" :: held 1.847s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:42 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] Created reservations ['8a59176e-fc61-4b97-9f88-60bdddc1f48e'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:42 devstack cinder-volume[86805]: WARNING cinder.quota [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1408160990 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1408160990, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:01:42 devstack cinder-volume[86805]: WARNING cinder.quota [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1408160990 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1408160990, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:01:42 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] Created reservations ['5e0c81f7-81a0-47f2-a4f4-09aa2917dbb2', 'a492bb25-cd39-42c7-86b1-4a56588e5654', '5121a06d-380d-4402-9a9d-95ac4f132db7', '57996529-b0c4-4cba-9f75-ee07273202fe'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:42 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:01:42 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:43 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-8e3a7140-8038-43d6-92eb-78159a8b2e4a tempest-GroupsTest-400350059 None] Created reservations ['cccef1ca-8fab-43f1-be53-f6ef24490ea3'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8e3a7140-8038-43d6-92eb-78159a8b2e4a tempest-GroupsTest-400350059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8e3a7140-8038-43d6-92eb-78159a8b2e4a tempest-GroupsTest-400350059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8e3a7140-8038-43d6-92eb-78159a8b2e4a tempest-GroupsTest-400350059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8e3a7140-8038-43d6-92eb-78159a8b2e4a tempest-GroupsTest-400350059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8e3a7140-8038-43d6-92eb-78159a8b2e4a tempest-GroupsTest-400350059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8e3a7140-8038-43d6-92eb-78159a8b2e4a tempest-GroupsTest-400350059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:43 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:01:43 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:43 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.985s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:43 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:43 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-cdfe4f17-67c2-445a-81f1-81b77206f713 tempest-GroupsTest-400350059 None] Delete group completed successfully. Jul 03 14:01:44 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8e3a7140-8038-43d6-92eb-78159a8b2e4a tempest-GroupsTest-400350059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.889s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:44 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-8e3a7140-8038-43d6-92eb-78159a8b2e4a tempest-GroupsTest-400350059 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:44 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-8e3a7140-8038-43d6-92eb-78159a8b2e4a tempest-GroupsTest-400350059 None] Delete group completed successfully. Jul 03 14:01:45 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-8f3729dc-ce29-4603-8954-8c3c368617d0 tempest-GroupsTest-400350059 None] Group tempest-GroupsTest-Group-557903015: creating Jul 03 14:01:45 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-8f3729dc-ce29-4603-8954-8c3c368617d0 tempest-GroupsTest-400350059 None] Group tempest-GroupsTest-Group-557903015: created successfully Jul 03 14:01:45 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-8f3729dc-ce29-4603-8954-8c3c368617d0 tempest-GroupsTest-400350059 None] Create group completed successfully. Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Flow 'volume_create_manager' (0def05bd-637b-49f3-8c45-6507d7e0930e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1cb55f-7b2c-447b-ac4f-2fa119441547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1cb55f-7b2c-447b-ac4f-2fa119441547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2052553582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=231b4454-c193-44ea-bc8f-3cfcd6023b97,host='devstack@QuobyteHD#QuobyteHD',id=40929967-1101-4509-83d3-5217ced336dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c956e161e8341b481d32670cc48151a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:47Z,use_quota=True,user_id='b844d64028af455486556b7ccea82bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98687117-cd20-4613-95a7-06f2fcc9b7cb),volume_type_id=98687117-cd20-4613-95a7-06f2fcc9b7cb)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d318168-5651-45af-8ace-a5195d2f485d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d318168-5651-45af-8ace-a5195d2f485d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24d132d-f7e0-4387-870c-4e5b3b4fb92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24d132d-f7e0-4387-870c-4e5b3b4fb92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40929967-1101-4509-83d3-5217ced336dd', 'volume_name': 'volume-40929967-1101-4509-83d3-5217ced336dd', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76580b7a-c5a6-4318-ac57-5799b9daa8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76580b7a-c5a6-4318-ac57-5799b9daa8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736af7eb-2b2f-42c3-b88f-3f0b7e9a3999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:47 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Volume 40929967-1101-4509-83d3-5217ced336dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40929967-1101-4509-83d3-5217ced336dd', 'volume_size': 1} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=231b4454-c193-44ea-bc8f-3cfcd6023b97,created_at=2026-07-03T12:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2052553582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=231b4454-c193-44ea-bc8f-3cfcd6023b97,host='devstack@QuobyteHD#QuobyteHD',id=40929967-1101-4509-83d3-5217ced336dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c956e161e8341b481d32670cc48151a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:47Z,use_quota=True,user_id='b844d64028af455486556b7ccea82bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98687117-cd20-4613-95a7-06f2fcc9b7cb),volume_type_id=98687117-cd20-4613-95a7-06f2fcc9b7cb)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Creating volume 40929967-1101-4509-83d3-5217ced336dd {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:01:47 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:01:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-40929967-1101-4509-83d3-5217ced336dd 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:47 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-40929967-1101-4509-83d3-5217ced336dd 1073741824 Jul 03 14:01:47 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:48 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-40929967-1101-4509-83d3-5217ced336dd 1073741824" returned: 0 in 1.163s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-40929967-1101-4509-83d3-5217ced336dd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:48 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-40929967-1101-4509-83d3-5217ced336dd Jul 03 14:01:48 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:49 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-40929967-1101-4509-83d3-5217ced336dd" returned: 0 in 0.827s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:01:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736af7eb-2b2f-42c3-b88f-3f0b7e9a3999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40929967-1101-4509-83d3-5217ced336dd', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6ad289-9651-43eb-8311-ffe99df7d028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:49 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Volume volume-40929967-1101-4509-83d3-5217ced336dd (40929967-1101-4509-83d3-5217ced336dd): created successfully Jul 03 14:01:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6ad289-9651-43eb-8311-ffe99df7d028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Flow 'volume_create_manager' (0def05bd-637b-49f3-8c45-6507d7e0930e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:49 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-bf8d0087-26b2-43c1-badb-ded2db8abcf6 tempest-GroupsTest-400350059 None] Created volume successfully. Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=132,cinder:SELECT=106,cinder:INSERT=26,cinder:DELETE=6 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=101,cinder:UPDATE=128,cinder:DELETE=14,cinder:INSERT=32 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Flow 'volume_create_manager' (e2d2cf06-89d1-4c87-9c95-53988e712e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c88012-f86d-4f38-8348-43aadae34a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c88012-f86d-4f38-8348-43aadae34a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1682285294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=231b4454-c193-44ea-bc8f-3cfcd6023b97,host='devstack@QuobyteHD#QuobyteHD',id=3339e087-d873-410f-9467-afd8010820d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c956e161e8341b481d32670cc48151a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:50Z,use_quota=True,user_id='b844d64028af455486556b7ccea82bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98687117-cd20-4613-95a7-06f2fcc9b7cb),volume_type_id=98687117-cd20-4613-95a7-06f2fcc9b7cb)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712a5f1c-f434-46f6-a329-529d279c6129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712a5f1c-f434-46f6-a329-529d279c6129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496d65d5-67b3-4472-b2a9-59376ec0b214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496d65d5-67b3-4472-b2a9-59376ec0b214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3339e087-d873-410f-9467-afd8010820d4', 'volume_name': 'volume-3339e087-d873-410f-9467-afd8010820d4', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee827429-c03f-441e-9830-111e4c13ee56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee827429-c03f-441e-9830-111e4c13ee56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee62b706-a3e3-4f79-bf6c-6b9248c46912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:50 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Volume 3339e087-d873-410f-9467-afd8010820d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3339e087-d873-410f-9467-afd8010820d4', 'volume_size': 1} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=231b4454-c193-44ea-bc8f-3cfcd6023b97,created_at=2026-07-03T12:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1682285294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=231b4454-c193-44ea-bc8f-3cfcd6023b97,host='devstack@QuobyteHD#QuobyteHD',id=3339e087-d873-410f-9467-afd8010820d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c956e161e8341b481d32670cc48151a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:50Z,use_quota=True,user_id='b844d64028af455486556b7ccea82bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98687117-cd20-4613-95a7-06f2fcc9b7cb),volume_type_id=98687117-cd20-4613-95a7-06f2fcc9b7cb)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Creating volume 3339e087-d873-410f-9467-afd8010820d4 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:01:50 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:01:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3339e087-d873-410f-9467-afd8010820d4 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:50 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3339e087-d873-410f-9467-afd8010820d4 1073741824 Jul 03 14:01:50 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:51 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3339e087-d873-410f-9467-afd8010820d4 1073741824" returned: 0 in 1.111s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3339e087-d873-410f-9467-afd8010820d4 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:51 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3339e087-d873-410f-9467-afd8010820d4 Jul 03 14:01:51 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:52 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3339e087-d873-410f-9467-afd8010820d4" returned: 0 in 0.789s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:01:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee62b706-a3e3-4f79-bf6c-6b9248c46912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3339e087-d873-410f-9467-afd8010820d4', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fc621a-a84e-4757-a4da-c9c0a31628b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:52 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Volume volume-3339e087-d873-410f-9467-afd8010820d4 (3339e087-d873-410f-9467-afd8010820d4): created successfully Jul 03 14:01:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fc621a-a84e-4757-a4da-c9c0a31628b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Flow 'volume_create_manager' (e2d2cf06-89d1-4c87-9c95-53988e712e49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:52 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-50172f1a-72cb-4706-916b-c55ec3c4e67c tempest-GroupsTest-400350059 None] Created volume successfully. Jul 03 14:01:53 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f46178a6-0c79-4e18-a995-10a55e7d189a tempest-GroupsTest-400350059 None] Update group completed successfully. Jul 03 14:01:54 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-2b95956b-e02e-4e5c-9ef4-8eaf1cc6f705 tempest-GroupsTest-400350059 None] Update group completed successfully. Jul 03 14:01:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Acquiring lock "cinder-quobyte-3339e087-d873-410f-9467-afd8010820d4" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Lock "cinder-quobyte-3339e087-d873-410f-9467-afd8010820d4" acquired by "delete_volume" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:56 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f0f007-fbf7-49a7-b500-0309066d3faf]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3339e087-d873-410f-9467-afd8010820d4 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:56 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3339e087-d873-410f-9467-afd8010820d4 Jul 03 14:01:56 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:57 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3339e087-d873-410f-9467-afd8010820d4" returned: 0 in 1.234s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3339e087-d873-410f-9467-afd8010820d4 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:58 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3339e087-d873-410f-9467-afd8010820d4 Jul 03 14:01:58 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:01:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:58 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:01:58 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:59 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3339e087-d873-410f-9467-afd8010820d4" returned: 0 in 1.648s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Lock "cinder-quobyte-3339e087-d873-410f-9467-afd8010820d4" released by "delete_volume" :: held 3.006s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Acquiring lock "cinder-quobyte-40929967-1101-4509-83d3-5217ced336dd" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Lock "cinder-quobyte-40929967-1101-4509-83d3-5217ced336dd" acquired by "delete_volume" :: waited 0.084s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:59 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc681133-2f51-42c2-a384-5cc6a7eef32b]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-40929967-1101-4509-83d3-5217ced336dd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:00 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-40929967-1101-4509-83d3-5217ced336dd Jul 03 14:02:00 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Flow 'volume_create_manager' (1c4ee483-2bda-4cf1-9b00-72646b3b7ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e170bdae-7ee1-4926-9c4f-e85b861f5298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e170bdae-7ee1-4926-9c4f-e85b861f5298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1192036799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621ecf53-5379-433e-923c-91d24d8b5c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0282d4f48254188a186d30879b0be7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:00Z,use_quota=True,user_id='73d042709b214034896cc50490ba4bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d58ab2-f797-4930-a93b-f58e1b967870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d58ab2-f797-4930-a93b-f58e1b967870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc458312-3c6c-49dc-b16d-32d3fbcd2b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc458312-3c6c-49dc-b16d-32d3fbcd2b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '621ecf53-5379-433e-923c-91d24d8b5c55', 'volume_name': 'volume-621ecf53-5379-433e-923c-91d24d8b5c55', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7258abb-8472-4020-8dc6-266f230f192a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7258abb-8472-4020-8dc6-266f230f192a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48f76e1-c381-46a1-8aac-ea6917333476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:00 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Volume 621ecf53-5379-433e-923c-91d24d8b5c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-621ecf53-5379-433e-923c-91d24d8b5c55', 'volume_size': 1} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1192036799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621ecf53-5379-433e-923c-91d24d8b5c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0282d4f48254188a186d30879b0be7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:00Z,use_quota=True,user_id='73d042709b214034896cc50490ba4bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Creating volume 621ecf53-5379-433e-923c-91d24d8b5c55 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:02:00 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-621ecf53-5379-433e-923c-91d24d8b5c55 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:00 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-621ecf53-5379-433e-923c-91d24d8b5c55 1073741824 Jul 03 14:02:00 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:00 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 2.159s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:00 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:01 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-621ecf53-5379-433e-923c-91d24d8b5c55 1073741824" returned: 0 in 1.438s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-621ecf53-5379-433e-923c-91d24d8b5c55 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:02 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-621ecf53-5379-433e-923c-91d24d8b5c55 Jul 03 14:02:02 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:02 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-40929967-1101-4509-83d3-5217ced336dd" returned: 0 in 2.192s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-40929967-1101-4509-83d3-5217ced336dd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:02 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-40929967-1101-4509-83d3-5217ced336dd Jul 03 14:02:02 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:03 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-621ecf53-5379-433e-923c-91d24d8b5c55" returned: 0 in 1.306s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] <== create_volume: return (2827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.833s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48f76e1-c381-46a1-8aac-ea6917333476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-621ecf53-5379-433e-923c-91d24d8b5c55', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39024dc0-7e37-4599-926c-5cb050bdaacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:03 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Volume volume-621ecf53-5379-433e-923c-91d24d8b5c55 (621ecf53-5379-433e-923c-91d24d8b5c55): created successfully Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39024dc0-7e37-4599-926c-5cb050bdaacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Flow 'volume_create_manager' (1c4ee483-2bda-4cf1-9b00-72646b3b7ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:03 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-9e026125-c556-45c1-8cd8-0a45c13f9e52 tempest-VolumesListAdminTestJSON-35516287 None] Created volume successfully. Jul 03 14:02:03 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-40929967-1101-4509-83d3-5217ced336dd" returned: 0 in 1.295s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Lock "cinder-quobyte-40929967-1101-4509-83d3-5217ced336dd" released by "delete_volume" :: held 3.616s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Created reservations ['06b9da67-1baa-4896-898a-23ae59afb996'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:03 devstack cinder-volume[86805]: WARNING cinder.quota [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-914754275 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-914754275, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:02:03 devstack cinder-volume[86805]: WARNING cinder.quota [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-914754275 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-914754275, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Created reservations ['efc47f24-ce94-4289-a1a1-ac9b6407b5f3', '189454a8-cdc9-4970-862c-529ec9e39b35', 'fd0d6aef-78c6-406e-8b63-f24fc33ba5ce', '1a14d8fa-95b6-4a43-8f61-5cdd66e0d9c0'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Created reservations ['e53f2cac-f0c3-4416-ad99-997b604084a6', '04b6c0be-ccf3-4b43-a82a-a5200b6b8a02', 'e177344b-3f5a-4010-9f31-b6321d6e6134', 'ec07dd75-6aa2-4b89-885e-6e77a8e5440c'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:04 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:02:04 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:05 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.534s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:05 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:05 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-03a4948f-2b01-4587-962b-e3312894ce94 tempest-GroupsTest-400350059 None] Delete group completed successfully. Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Flow 'volume_create_manager' (66941918-162f-4b23-9cb7-f64b04bc9b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494b0235-abfc-4967-9aad-526575960bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494b0235-abfc-4967-9aad-526575960bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1004096754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef1587af-04de-41a2-9bc6-e5a6b15b4b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0282d4f48254188a186d30879b0be7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:06Z,use_quota=True,user_id='73d042709b214034896cc50490ba4bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b881b06-6a6d-4a09-b646-d06614d581fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b881b06-6a6d-4a09-b646-d06614d581fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c88b13-2eb1-4276-9688-035a1924d621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c88b13-2eb1-4276-9688-035a1924d621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef1587af-04de-41a2-9bc6-e5a6b15b4b61', 'volume_name': 'volume-ef1587af-04de-41a2-9bc6-e5a6b15b4b61', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc305fb-5c73-4cba-a1c6-a58d2120eb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc305fb-5c73-4cba-a1c6-a58d2120eb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd84f60d-0155-4714-9254-046c3ade4369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:06 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Volume ef1587af-04de-41a2-9bc6-e5a6b15b4b61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef1587af-04de-41a2-9bc6-e5a6b15b4b61', 'volume_size': 1} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1004096754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef1587af-04de-41a2-9bc6-e5a6b15b4b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0282d4f48254188a186d30879b0be7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:06Z,use_quota=True,user_id='73d042709b214034896cc50490ba4bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Creating volume ef1587af-04de-41a2-9bc6-e5a6b15b4b61 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:02:06 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:02:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ef1587af-04de-41a2-9bc6-e5a6b15b4b61 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:06 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ef1587af-04de-41a2-9bc6-e5a6b15b4b61 1073741824 Jul 03 14:02:06 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:07 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ef1587af-04de-41a2-9bc6-e5a6b15b4b61 1073741824" returned: 0 in 1.365s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ef1587af-04de-41a2-9bc6-e5a6b15b4b61 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:07 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ef1587af-04de-41a2-9bc6-e5a6b15b4b61 Jul 03 14:02:07 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:08 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ef1587af-04de-41a2-9bc6-e5a6b15b4b61" returned: 0 in 0.916s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] <== create_volume: return (2373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:02:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.382s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd84f60d-0155-4714-9254-046c3ade4369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef1587af-04de-41a2-9bc6-e5a6b15b4b61', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368206de-3836-40ec-9449-9ed5256fee11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:08 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Volume volume-ef1587af-04de-41a2-9bc6-e5a6b15b4b61 (ef1587af-04de-41a2-9bc6-e5a6b15b4b61): created successfully Jul 03 14:02:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368206de-3836-40ec-9449-9ed5256fee11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Flow 'volume_create_manager' (66941918-162f-4b23-9cb7-f64b04bc9b5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:08 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-672c7231-dab5-47b9-a888-a2bc4c86a412 tempest-VolumesListAdminTestJSON-35516287 None] Created volume successfully. Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Flow 'volume_create_manager' (db13a221-e94b-451b-b644-992c64d754f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14a8746-3c9f-41ee-bd9d-01bb837bc535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14a8746-3c9f-41ee-bd9d-01bb837bc535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-687336925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5881d46c-0bf0-49c9-bda8-b7d9c31c31bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0282d4f48254188a186d30879b0be7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:10Z,use_quota=True,user_id='73d042709b214034896cc50490ba4bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b92d0d39-6bc9-4e3d-bb46-63a9da4d4b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b92d0d39-6bc9-4e3d-bb46-63a9da4d4b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4227cdad-5a2c-4103-b636-4561a9c22a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4227cdad-5a2c-4103-b636-4561a9c22a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5881d46c-0bf0-49c9-bda8-b7d9c31c31bb', 'volume_name': 'volume-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ba8e24-8a5a-4a30-bf51-e7b017708e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ba8e24-8a5a-4a30-bf51-e7b017708e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577b6f81-ba0d-4d82-a523-918a1aca8261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:10 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Volume 5881d46c-0bf0-49c9-bda8-b7d9c31c31bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb', 'volume_size': 1} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-687336925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5881d46c-0bf0-49c9-bda8-b7d9c31c31bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0282d4f48254188a186d30879b0be7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:10Z,use_quota=True,user_id='73d042709b214034896cc50490ba4bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Creating volume 5881d46c-0bf0-49c9-bda8-b7d9c31c31bb {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:02:10 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:02:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:10 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb 1073741824 Jul 03 14:02:10 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:11 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb 1073741824" returned: 0 in 1.362s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:11 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb Jul 03 14:02:11 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:12 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb" returned: 0 in 0.884s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] <== create_volume: return (2330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:02:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.333s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577b6f81-ba0d-4d82-a523-918a1aca8261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5222ffe6-5614-4476-a097-20b7185517c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:12 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Volume volume-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb (5881d46c-0bf0-49c9-bda8-b7d9c31c31bb): created successfully Jul 03 14:02:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5222ffe6-5614-4476-a097-20b7185517c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Flow 'volume_create_manager' (db13a221-e94b-451b-b644-992c64d754f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:12 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-5bdac19c-fe3c-4e8e-b8f6-7e70f21746f3 tempest-VolumesListAdminTestJSON-35516287 None] Created volume successfully. Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Flow 'volume_create_manager' (249f5022-4259-4e1e-bc11-469b63448807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1263ba3-5e6e-42c8-861f-3b6736064f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1263ba3-5e6e-42c8-861f-3b6736064f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9befc43-0d8d-4fe8-a12e-65e6cacf52d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a52046f69f4e35a2ce40e25f5f2b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:14Z,use_quota=True,user_id='14190dbbfd3c4b149fcd43e3aba73068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51726c8a-65c0-4424-b1ed-7d510031d007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51726c8a-65c0-4424-b1ed-7d510031d007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4e2980-a714-4c87-ab71-808aad9502cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4e2980-a714-4c87-ab71-808aad9502cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9befc43-0d8d-4fe8-a12e-65e6cacf52d5', 'volume_name': 'volume-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8484f514-f09d-427a-b7e2-7538564faad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8484f514-f09d-427a-b7e2-7538564faad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef129e5c-c9e6-4e39-a707-a3ccf2b3d240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:14 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Volume f9befc43-0d8d-4fe8-a12e-65e6cacf52d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5', 'volume_size': 1} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9befc43-0d8d-4fe8-a12e-65e6cacf52d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a52046f69f4e35a2ce40e25f5f2b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:14Z,use_quota=True,user_id='14190dbbfd3c4b149fcd43e3aba73068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Creating volume f9befc43-0d8d-4fe8-a12e-65e6cacf52d5 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:02:14 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:02:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:14 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5 1073741824 Jul 03 14:02:14 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:15 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5 1073741824" returned: 0 in 1.030s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:15 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5 Jul 03 14:02:15 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:15 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5" returned: 0 in 0.710s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:02:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef129e5c-c9e6-4e39-a707-a3ccf2b3d240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ee43fb-a794-4ee3-943d-e52fefc58fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:16 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Volume volume-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5 (f9befc43-0d8d-4fe8-a12e-65e6cacf52d5): created successfully Jul 03 14:02:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ee43fb-a794-4ee3-943d-e52fefc58fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Flow 'volume_create_manager' (249f5022-4259-4e1e-bc11-469b63448807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:16 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b4f1638e-bf1e-464b-9776-8a9cbb7d1d49 tempest-VolumesListAdminTestJSON-441024668 None] Created volume successfully. Jul 03 14:02:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] Acquiring lock "cinder-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] Lock "cinder-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] Acquiring lock "cinder-quobyte-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] Lock "cinder-quobyte-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5" acquired by "delete_volume" :: waited 0.031s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:17 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b40fb1e-6c58-40a5-8fc2-4532b84f7c25]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] Acquiring lock "cinder-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] Lock "cinder-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] Acquiring lock "cinder-quobyte-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] Lock "cinder-quobyte-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb" acquired by "delete_volume" :: waited 0.030s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:17 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fdfedb-c0c5-4253-b478-1d4248e6581e]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:17 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5 Jul 03 14:02:17 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:17 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb Jul 03 14:02:17 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:18 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb" returned: 0 in 1.121s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:18 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5" returned: 0 in 1.398s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:18 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb Jul 03 14:02:18 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:18 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5 Jul 03 14:02:18 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:20 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb" returned: 0 in 1.301s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] Lock "cinder-quobyte-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb" released by "delete_volume" :: held 2.503s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:20 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5" returned: 0 in 1.332s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] Lock "cinder-quobyte-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5" released by "delete_volume" :: held 2.823s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] Created reservations ['1a00585d-e0e2-4f9a-afb6-043b28b31744', 'bfd35e74-bd83-4423-8f29-87b8510ec55c', '53786519-e92a-465f-9648-d253904c217e', 'd380718b-72cc-4858-813a-41ac3f103f08'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] Created reservations ['80fa1110-8144-43cd-ab04-3b63f571fe59', 'c93ec9fc-fc9a-4a7f-a179-ce5516a92aba', 'd7c83307-cbe1-463f-a6d7-9fbbc4ab7164', '51078746-762a-49cc-9a67-d055ac503571'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:20 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:02:20 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:20 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:02:20 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] Acquiring lock "cinder-ef1587af-04de-41a2-9bc6-e5a6b15b4b61-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] Lock "cinder-ef1587af-04de-41a2-9bc6-e5a6b15b4b61-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] Acquiring lock "cinder-quobyte-ef1587af-04de-41a2-9bc6-e5a6b15b4b61" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] Lock "cinder-quobyte-ef1587af-04de-41a2-9bc6-e5a6b15b4b61" acquired by "delete_volume" :: waited 0.039s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:21 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b130f7-312e-48bd-b37a-5a0e2e86228f]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ef1587af-04de-41a2-9bc6-e5a6b15b4b61 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:21 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.178s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:21 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:21 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ef1587af-04de-41a2-9bc6-e5a6b15b4b61 Jul 03 14:02:21 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:21 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] Deleted volume successfully. Jul 03 14:02:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c085fd15-ebfc-46eb-8da5-4c241512d8dd tempest-VolumesListAdminTestJSON-441024668 None] Lock "cinder-f9befc43-0d8d-4fe8-a12e-65e6cacf52d5-delete_volume" released by "delete_volume" :: held 4.578s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:22 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.482s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:22 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] Deleted volume successfully. Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-06a7c5a1-a040-450e-bad6-6f882e7dded0 tempest-VolumesListAdminTestJSON-35516287 None] Lock "cinder-5881d46c-0bf0-49c9-bda8-b7d9c31c31bb-delete_volume" released by "delete_volume" :: held 4.536s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Flow 'volume_create_manager' (a66af55a-1053-45f0-9d52-36ae384fb891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d6c144-0e9a-40b6-8e58-e73667ccec8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:22 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d6c144-0e9a-40b6-8e58-e73667ccec8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1501653056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6d7f80-83af-4f8c-a784-c6d66662b1d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f7c64c2f1244e0b299bff38cb5ce26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:23Z,use_quota=True,user_id='b0b7b30a755e4d18bc8b60fcc3a0b35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e041c2-79d3-47c7-bac4-e34dc9638405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e041c2-79d3-47c7-bac4-e34dc9638405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967dbf59-4d14-43e3-8cc1-1aff6e4a4ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967dbf59-4d14-43e3-8cc1-1aff6e4a4ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc6d7f80-83af-4f8c-a784-c6d66662b1d3', 'volume_name': 'volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cb3a21-efa6-48d1-b4e4-ecaf657528ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cb3a21-efa6-48d1-b4e4-ecaf657528ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7dfe0c1-46d3-44c2-9feb-594a01099826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:22 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Volume dc6d7f80-83af-4f8c-a784-c6d66662b1d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3', 'volume_size': 1} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1501653056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6d7f80-83af-4f8c-a784-c6d66662b1d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f7c64c2f1244e0b299bff38cb5ce26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:23Z,use_quota=True,user_id='b0b7b30a755e4d18bc8b60fcc3a0b35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Creating volume dc6d7f80-83af-4f8c-a784-c6d66662b1d3 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:02:22 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ef1587af-04de-41a2-9bc6-e5a6b15b4b61" returned: 0 in 1.312s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ef1587af-04de-41a2-9bc6-e5a6b15b4b61 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:22 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3 1073741824 Jul 03 14:02:22 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:22 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ef1587af-04de-41a2-9bc6-e5a6b15b4b61 Jul 03 14:02:22 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:23 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ef1587af-04de-41a2-9bc6-e5a6b15b4b61" returned: 0 in 0.780s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] Lock "cinder-quobyte-ef1587af-04de-41a2-9bc6-e5a6b15b4b61" released by "delete_volume" :: held 2.169s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:23 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] Created reservations ['f8cb4043-5071-4a64-9590-a55e80644ab8', 'd447c97b-a767-4f5b-b43d-e0d2162ca6c3', '4674f397-af10-41f4-af69-9a7125108f06', 'a63aa8ec-faaf-48db-8315-f8fc6d3f6a4d'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:23 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:02:23 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:24 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3 1073741824" returned: 0 in 1.071s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:24 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3 Jul 03 14:02:24 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:24 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.738s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:24 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:24 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] Deleted volume successfully. Jul 03 14:02:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f0532106-f495-4952-9a3f-4fc83a07be0d tempest-VolumesListAdminTestJSON-35516287 None] Lock "cinder-ef1587af-04de-41a2-9bc6-e5a6b15b4b61-delete_volume" released by "delete_volume" :: held 3.285s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:24 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3" returned: 0 in 0.800s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:02:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] Acquiring lock "cinder-621ecf53-5379-433e-923c-91d24d8b5c55-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7dfe0c1-46d3-44c2-9feb-594a01099826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7bcb330-bf3b-4f40-93e1-8a86ae047c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] Lock "cinder-621ecf53-5379-433e-923c-91d24d8b5c55-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:24 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Volume volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3 (dc6d7f80-83af-4f8c-a784-c6d66662b1d3): created successfully Jul 03 14:02:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7bcb330-bf3b-4f40-93e1-8a86ae047c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Flow 'volume_create_manager' (a66af55a-1053-45f0-9d52-36ae384fb891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:24 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-63e695ab-16b1-43a2-92d4-a4fecc4328d5 tempest-AttachVolumeNegativeTest-1388742330 None] Created volume successfully. Jul 03 14:02:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] Acquiring lock "cinder-quobyte-621ecf53-5379-433e-923c-91d24d8b5c55" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] Lock "cinder-quobyte-621ecf53-5379-433e-923c-91d24d8b5c55" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:25 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0349f599-8bc8-4d64-bb23-f845e6bbddc3]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-621ecf53-5379-433e-923c-91d24d8b5c55 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:25 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-621ecf53-5379-433e-923c-91d24d8b5c55 Jul 03 14:02:25 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:25 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-621ecf53-5379-433e-923c-91d24d8b5c55" returned: 0 in 0.982s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-621ecf53-5379-433e-923c-91d24d8b5c55 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:26 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-621ecf53-5379-433e-923c-91d24d8b5c55 Jul 03 14:02:26 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:26 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-621ecf53-5379-433e-923c-91d24d8b5c55" returned: 0 in 0.744s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] Lock "cinder-quobyte-621ecf53-5379-433e-923c-91d24d8b5c55" released by "delete_volume" :: held 1.766s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:26 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] Created reservations ['33a12932-66c9-45b3-9a2d-0f0941f5e48e', 'cda6f692-c847-4926-a963-473245d55abe', '0be9870f-2883-4609-bb1d-f4a1d9f95119', 'd269cd21-2b64-4447-b2e6-71dc61b63b37'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:26 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:02:26 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:28 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.144s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:28 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] Deleted volume successfully. Jul 03 14:02:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8d502de4-3674-4386-ad05-5ca9ff7275dd tempest-VolumesListAdminTestJSON-35516287 None] Lock "cinder-621ecf53-5379-433e-923c-91d24d8b5c55-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-0e80a49b-7bad-48bc-b6e8-e7fa0b6cd756 req-46d3bad2-657a-4921-8c9d-d0cb1def2c2f tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-0e80a49b-7bad-48bc-b6e8-e7fa0b6cd756 req-46d3bad2-657a-4921-8c9d-d0cb1def2c2f tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:30 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70bb90e-9ba5-4a37-bb27-8cfe8fd1799a]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-0e80a49b-7bad-48bc-b6e8-e7fa0b6cd756 req-46d3bad2-657a-4921-8c9d-d0cb1def2c2f tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:30 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3 Jul 03 14:02:30 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:31 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-0e80a49b-7bad-48bc-b6e8-e7fa0b6cd756 req-46d3bad2-657a-4921-8c9d-d0cb1def2c2f tempest-AttachVolumeNegativeTest-1388742330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3" returned: 0 in 1.197s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-0e80a49b-7bad-48bc-b6e8-e7fa0b6cd756 req-46d3bad2-657a-4921-8c9d-d0cb1def2c2f tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.252s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-0e80a49b-7bad-48bc-b6e8-e7fa0b6cd756 req-46d3bad2-657a-4921-8c9d-d0cb1def2c2f tempest-AttachVolumeNegativeTest-1388742330 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c7dcfc7-2921-4e14-a289-fd8c371349ed', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:02:31 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-0e80a49b-7bad-48bc-b6e8-e7fa0b6cd756 req-46d3bad2-657a-4921-8c9d-d0cb1def2c2f tempest-AttachVolumeNegativeTest-1388742330 None] attachment_update completed successfully. Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Flow 'volume_create_manager' (1b7fe544-d19a-4bb6-a58b-ffa917cfbe4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7796709-c753-4a02-a9b8-5382369718b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7796709-c753-4a02-a9b8-5382369718b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-278293526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24cc1dbc-6b5a-413d-956d-22ee3ed682c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aefb4d7cedaa42548b513f2dce4bb7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:35Z,use_quota=True,user_id='13fb3d4ada2e41b6adae0228b4164e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eec7787-3a77-48b8-a08e-0b68750bb949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eec7787-3a77-48b8-a08e-0b68750bb949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a61f648-9f59-44a0-b5bf-9d8faa08d2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a61f648-9f59-44a0-b5bf-9d8faa08d2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24cc1dbc-6b5a-413d-956d-22ee3ed682c4', 'volume_name': 'volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fac7c0-7971-41b8-9fcb-ca89d01139d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fac7c0-7971-41b8-9fcb-ca89d01139d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b6d7a4-2dbd-4770-89e7-b4c525ba90c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:34 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Volume 24cc1dbc-6b5a-413d-956d-22ee3ed682c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4', 'volume_size': 1} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-278293526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24cc1dbc-6b5a-413d-956d-22ee3ed682c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aefb4d7cedaa42548b513f2dce4bb7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:35Z,use_quota=True,user_id='13fb3d4ada2e41b6adae0228b4164e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Creating volume 24cc1dbc-6b5a-413d-956d-22ee3ed682c4 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:02:34 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:02:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:35 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4 1073741824 Jul 03 14:02:35 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:35 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:02:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Flow 'volume_create_manager' (7a1a6e87-9a3f-4d34-8bbc-35719993cbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97822be7-ff94-4516-8f4e-9701255ea2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97822be7-ff94-4516-8f4e-9701255ea2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-460723544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b353ceb9-8694-40fb-bef9-718015e1bf0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e150fac4194649d8942e23b1fbd201a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:35Z,use_quota=True,user_id='62b92dd24c73407aa30d34a64d96ad57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026d9acd-9d1d-41f5-b471-a83fa0317fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026d9acd-9d1d-41f5-b471-a83fa0317fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f0f7eb-62d4-4d8d-9693-5cfd76f17425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f0f7eb-62d4-4d8d-9693-5cfd76f17425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b353ceb9-8694-40fb-bef9-718015e1bf0b', 'volume_name': 'volume-b353ceb9-8694-40fb-bef9-718015e1bf0b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (762ffc2e-266a-4817-9521-438af162c9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (762ffc2e-266a-4817-9521-438af162c9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c181f2fc-be8b-4380-a477-ad0725ed66df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:35 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Volume b353ceb9-8694-40fb-bef9-718015e1bf0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b353ceb9-8694-40fb-bef9-718015e1bf0b', 'volume_size': 1} Jul 03 14:02:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:36 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4 1073741824" returned: 0 in 1.199s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:36 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4 Jul 03 14:02:36 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:37 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4" returned: 0 in 0.894s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:02:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.530s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-460723544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b353ceb9-8694-40fb-bef9-718015e1bf0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e150fac4194649d8942e23b1fbd201a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:35Z,use_quota=True,user_id='62b92dd24c73407aa30d34a64d96ad57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:02:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Creating volume b353ceb9-8694-40fb-bef9-718015e1bf0b {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:02:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:02:37 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:02:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b6d7a4-2dbd-4770-89e7-b4c525ba90c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e434c39-187b-4464-b400-e2093911a96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:37 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b 1073741824 Jul 03 14:02:37 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:37 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Volume volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4 (24cc1dbc-6b5a-413d-956d-22ee3ed682c4): created successfully Jul 03 14:02:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e434c39-187b-4464-b400-e2093911a96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Flow 'volume_create_manager' (1b7fe544-d19a-4bb6-a58b-ffa917cfbe4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:37 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-189372d6-017f-41ff-a8ae-9380aa498b17 tempest-TestMinimumBasicScenario-1712053428 None] Created volume successfully. Jul 03 14:02:38 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b 1073741824" returned: 0 in 1.103s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:38 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b Jul 03 14:02:38 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:39 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-eb59c605-968b-4111-bdb7-cf02a492540b req-92f9935d-97e6-47b0-83fc-0bb6bea434cb tempest-AttachVolumeNegativeTest-1388742330 None] Terminate volume connection completed successfully. Jul 03 14:02:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-eb59c605-968b-4111-bdb7-cf02a492540b req-92f9935d-97e6-47b0-83fc-0bb6bea434cb tempest-AttachVolumeNegativeTest-1388742330 None] Deleting attachment 0c7dcfc7-2921-4e14-a289-fd8c371349ed. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:02:39 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b" returned: 0 in 0.872s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:02:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c181f2fc-be8b-4380-a477-ad0725ed66df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b353ceb9-8694-40fb-bef9-718015e1bf0b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea08e66-e3d6-437d-896a-8acee7b20a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:39 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Volume volume-b353ceb9-8694-40fb-bef9-718015e1bf0b (b353ceb9-8694-40fb-bef9-718015e1bf0b): created successfully Jul 03 14:02:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea08e66-e3d6-437d-896a-8acee7b20a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Flow 'volume_create_manager' (7a1a6e87-9a3f-4d34-8bbc-35719993cbf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:39 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-30dce898-11f2-4539-ba56-1206553f9070 tempest-SnapshotMetadataTestJSON-2079135552 None] Created volume successfully. Jul 03 14:02:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] Creating offline snapshot 855e0998-ed0b-4b1f-985c-984d6e0de8a6 of volume b353ceb9-8694-40fb-bef9-718015e1bf0b {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:02:40 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b241c7a8-b9b9-4f4e-8922-e04ed492bd2c]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:40 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b Jul 03 14:02:40 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:41 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b" returned: 0 in 0.999s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:41 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6 1G Jul 03 14:02:41 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-fd419204-ddd1-4681-b3e2-c8ab5321cb2d req-a4d0e661-ccaa-4807-9a81-fd623d4a9ac1 tempest-TestMinimumBasicScenario-1712053428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:42 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6 1G" returned: 0 in 1.159s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b353ceb9-8694-40fb-bef9-718015e1bf0b -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:42 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b353ceb9-8694-40fb-bef9-718015e1bf0b -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6 Jul 03 14:02:42 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:43 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b353ceb9-8694-40fb-bef9-718015e1bf0b -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6" returned: 0 in 1.135s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:43 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6 is being set with open permissions: ugo+rw Jul 03 14:02:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:43 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6 Jul 03 14:02:43 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:44 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6" returned: 0 in 0.695s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:44 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.info Jul 03 14:02:44 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:45 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.info" returned: 0 in 0.838s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:45 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.info is being set with open permissions: ugo+rw Jul 03 14:02:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:45 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.info Jul 03 14:02:45 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:45 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.info" returned: 0 in 0.792s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.740s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-fd419204-ddd1-4681-b3e2-c8ab5321cb2d req-a4d0e661-ccaa-4807-9a81-fd623d4a9ac1 tempest-TestMinimumBasicScenario-1712053428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.203s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:45 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e977b588-f431-4a7b-8c45-cbb2755a4f9d]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-fd419204-ddd1-4681-b3e2-c8ab5321cb2d req-a4d0e661-ccaa-4807-9a81-fd623d4a9ac1 tempest-TestMinimumBasicScenario-1712053428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:45 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4816d0d8-8c14-49e7-85db-9157a4255f42 tempest-SnapshotMetadataTestJSON-2079135552 None] Create snapshot completed successfully Jul 03 14:02:46 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4 Jul 03 14:02:46 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:46 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-fd419204-ddd1-4681-b3e2-c8ab5321cb2d req-a4d0e661-ccaa-4807-9a81-fd623d4a9ac1 tempest-TestMinimumBasicScenario-1712053428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4" returned: 0 in 0.987s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-fd419204-ddd1-4681-b3e2-c8ab5321cb2d req-a4d0e661-ccaa-4807-9a81-fd623d4a9ac1 tempest-TestMinimumBasicScenario-1712053428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.020s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:46 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-fd419204-ddd1-4681-b3e2-c8ab5321cb2d req-a4d0e661-ccaa-4807-9a81-fd623d4a9ac1 tempest-TestMinimumBasicScenario-1712053428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29b4cf87-c1ee-48de-a6ba-1b03eff61134', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:02:47 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-fd419204-ddd1-4681-b3e2-c8ab5321cb2d req-a4d0e661-ccaa-4807-9a81-fd623d4a9ac1 tempest-TestMinimumBasicScenario-1712053428 None] attachment_update completed successfully. Jul 03 14:02:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] Acquiring lock "cinder-855e0998-ed0b-4b1f-985c-984d6e0de8a6-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "cinder-855e0998-ed0b-4b1f-985c-984d6e0de8a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] Acquiring lock "cinder-quobyte-b353ceb9-8694-40fb-bef9-718015e1bf0b" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "cinder-quobyte-b353ceb9-8694-40fb-bef9-718015e1bf0b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] Acquiring lock "cinder-quobyte-855e0998-ed0b-4b1f-985c-984d6e0de8a6" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "cinder-quobyte-855e0998-ed0b-4b1f-985c-984d6e0de8a6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] Deleting offline snapshot 855e0998-ed0b-4b1f-985c-984d6e0de8a6 of volume b353ceb9-8694-40fb-bef9-718015e1bf0b {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:02:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] snapshot_file for this snap is: volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:02:47 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a43d254-d535-4df6-b7ae-54b8e85232c5]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:47 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6 Jul 03 14:02:47 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:48 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6" returned: 0 in 0.914s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:48 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b353ceb9-8694-40fb-bef9-718015e1bf0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:02:48 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6730939-665b-4820-9358-56043d262d7d]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:48 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b Jul 03 14:02:48 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Flow 'volume_create_manager' (3373af5e-69bf-4b7f-9100-7661fcf9abd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af5fa5b-c3ee-4c2b-9486-ca6568984093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af5fa5b-c3ee-4c2b-9486-ca6568984093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1868561775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=150dd3c2-1484-4c92-80f0-bb4fa7077daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27da513c2204801bb57aba77088c901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:49Z,use_quota=True,user_id='b600028c74e14931947a11946bd79d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7497acf-90d2-43fc-b640-d69d231ca26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7497acf-90d2-43fc-b640-d69d231ca26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c73b33f-a459-4285-9558-a05b8f52d779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c73b33f-a459-4285-9558-a05b8f52d779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '150dd3c2-1484-4c92-80f0-bb4fa7077daa', 'volume_name': 'volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bac281-8479-48f0-9587-f3087c65cefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bac281-8479-48f0-9587-f3087c65cefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ea7de7-8090-4840-9775-8f11a9bae5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:49 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Volume 150dd3c2-1484-4c92-80f0-bb4fa7077daa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa', 'volume_size': 1} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1868561775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=150dd3c2-1484-4c92-80f0-bb4fa7077daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27da513c2204801bb57aba77088c901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:49Z,use_quota=True,user_id='b600028c74e14931947a11946bd79d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Creating volume 150dd3c2-1484-4c92-80f0-bb4fa7077daa {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:02:49 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:49 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa 1073741824 Jul 03 14:02:49 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:49 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b" returned: 0 in 1.070s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:49 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6 Jul 03 14:02:49 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:50 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa 1073741824" returned: 0 in 1.236s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:50 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa Jul 03 14:02:50 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6" returned: 0 in 1.039s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:50 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:50 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6 Jul 03 14:02:50 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "cinder-dc6d7f80-83af-4f8c-a784-c6d66662b1d3-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] Lock "cinder-dc6d7f80-83af-4f8c-a784-c6d66662b1d3-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:50 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=75,cinder:INSERT=17,cinder:UPDATE=82,cinder:DELETE=8 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:02:50 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=84,cinder:SELECT=69,cinder:DELETE=5,cinder:INSERT=18 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:02:51 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "cinder-quobyte-dc6d7f80-83af-4f8c-a784-c6d66662b1d3" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:51 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] Lock "cinder-quobyte-dc6d7f80-83af-4f8c-a784-c6d66662b1d3" acquired by "delete_volume" :: waited 0.036s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:51 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31b00f6-0b22-4973-ba2e-e3365324cc09]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:51 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3 Jul 03 14:02:51 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:51 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa" returned: 0 in 0.965s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:51 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] <== create_volume: return (2254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:02:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.258s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ea7de7-8090-4840-9775-8f11a9bae5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f443d703-54dc-478b-9a03-b92ba2e07d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:51 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Volume volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa (150dd3c2-1484-4c92-80f0-bb4fa7077daa): created successfully Jul 03 14:02:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f443d703-54dc-478b-9a03-b92ba2e07d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Flow 'volume_create_manager' (3373af5e-69bf-4b7f-9100-7661fcf9abd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:51 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-129d964a-a646-4148-a8d7-bfacb7ba35f1 tempest-VolumesDeleteCascade-674605090 None] Created volume successfully. Jul 03 14:02:51 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b.855e0998-ed0b-4b1f-985c-984d6e0de8a6" returned: 0 in 1.090s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:51 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "cinder-quobyte-855e0998-ed0b-4b1f-985c-984d6e0de8a6" released by "_delete_snapshot" :: held 4.266s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:51 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "cinder-quobyte-b353ceb9-8694-40fb-bef9-718015e1bf0b" released by "delete_snapshot" :: held 4.298s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:51 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] Created reservations ['d7cb5ba8-9de7-419e-9014-e26e1dc1a1a9', 'a47d9901-9e28-45b2-8212-5de7d74f0891', '5e98e753-4741-4cc6-839c-9c79be027985', 'cb60fd54-7cdf-4611-bcdf-c7ab87b5828f'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:51 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] Delete snapshot completed successfully. Jul 03 14:02:51 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fae24f59-f503-4aca-bb60-9894bd1f130f tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "cinder-855e0998-ed0b-4b1f-985c-984d6e0de8a6-delete_snapshot" released by "delete_snapshot" :: held 4.472s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:52 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3" returned: 0 in 0.935s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:52 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3 Jul 03 14:02:52 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] Creating offline snapshot 69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 of volume 150dd3c2-1484-4c92-80f0-bb4fa7077daa {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:02:52 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[282c46f7-0f14-4c96-a07a-e2c5c7d4e102]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:52 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dc6d7f80-83af-4f8c-a784-c6d66662b1d3" returned: 0 in 0.731s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] Lock "cinder-quobyte-dc6d7f80-83af-4f8c-a784-c6d66662b1d3" released by "delete_volume" :: held 1.777s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:52 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa Jul 03 14:02:52 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] Acquiring lock "cinder-b353ceb9-8694-40fb-bef9-718015e1bf0b-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "cinder-b353ceb9-8694-40fb-bef9-718015e1bf0b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] Created reservations ['a72216d5-881d-4d5b-a7de-24b11f9ea53f', 'f97dff50-0f38-49e0-86b5-e2c7f6107da6', '110ba997-dd41-42c8-b388-0fbd91359f75', '3f0539ee-af70-48af-9cbd-85f27ca5c2b5'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] Acquiring lock "cinder-quobyte-b353ceb9-8694-40fb-bef9-718015e1bf0b" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "cinder-quobyte-b353ceb9-8694-40fb-bef9-718015e1bf0b" acquired by "delete_volume" :: waited 0.033s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b1a1f9-6b06-42c6-80c2-1f84f67bcfe6]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:53 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:02:53 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:53 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b Jul 03 14:02:53 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "cinder-43636d8c-996d-4c4e-91aa-a478eb1d91ab-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "cinder-43636d8c-996d-4c4e-91aa-a478eb1d91ab-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "cinder-quobyte-43636d8c-996d-4c4e-91aa-a478eb1d91ab" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "cinder-quobyte-43636d8c-996d-4c4e-91aa-a478eb1d91ab" acquired by "delete_volume" :: waited 0.031s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d961052-b555-40a4-943c-f73cf38e33e6]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:53 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab Jul 03 14:02:53 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:53 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa" returned: 0 in 1.163s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:53 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 1G Jul 03 14:02:53 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:54 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.905s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:54 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:54 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] Deleted volume successfully. Jul 03 14:02:54 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0d6ad8da-7af9-43a5-99a1-72e3b3c7b88d tempest-AttachVolumeNegativeTest-1388742330 None] Lock "cinder-dc6d7f80-83af-4f8c-a784-c6d66662b1d3-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:54 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b" returned: 0 in 1.176s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:54 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b Jul 03 14:02:54 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:54 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab" returned: 0 in 1.033s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:54 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab Jul 03 14:02:54 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:54 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 1G" returned: 0 in 1.039s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:55 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 Jul 03 14:02:55 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:55 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b353ceb9-8694-40fb-bef9-718015e1bf0b" returned: 0 in 0.835s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "cinder-quobyte-b353ceb9-8694-40fb-bef9-718015e1bf0b" released by "delete_volume" :: held 2.097s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] Created reservations ['f8060655-ca6d-44ab-ace6-00d1a5318dc4', '8de17acc-5a4f-49d1-b21b-cbb2bd0b8ce0', '906df11e-a9e0-4cce-a7cb-15529e914bc7', '438f4066-aa8d-4c69-9774-fcc37d93d8e9'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:55 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:02:55 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:55 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43636d8c-996d-4c4e-91aa-a478eb1d91ab" returned: 0 in 0.771s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "cinder-quobyte-43636d8c-996d-4c4e-91aa-a478eb1d91ab" released by "delete_volume" :: held 1.881s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] Created reservations ['ae9cbc83-0cc5-4532-b387-835e30aabce3', '94b36d8a-3774-45be-af4a-b88b3e7c4cc9', '2895fe9d-f25a-428a-91f9-5ce7b4ec43ea', '49a871e1-03b3-4794-8ec4-6f4da20a245c'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:55 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:02:55 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:55 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20" returned: 0 in 1.020s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:55 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 is being set with open permissions: ugo+rw Jul 03 14:02:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:56 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 Jul 03 14:02:56 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "cinder-db6dec1e-b554-4b14-a2de-3fca7dfe052c-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:56 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.945s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:56 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "cinder-db6dec1e-b554-4b14-a2de-3fca7dfe052c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:56 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] Deleted volume successfully. Jul 03 14:02:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7ff8c32d-7aa7-4a54-92bf-f755b22dc706 tempest-SnapshotMetadataTestJSON-2079135552 None] Lock "cinder-b353ceb9-8694-40fb-bef9-718015e1bf0b-delete_volume" released by "delete_volume" :: held 3.354s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "cinder-quobyte-db6dec1e-b554-4b14-a2de-3fca7dfe052c" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "cinder-quobyte-db6dec1e-b554-4b14-a2de-3fca7dfe052c" acquired by "delete_volume" :: waited 0.037s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:56 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29057a6-8cfc-4b6c-846d-80b016a75b07]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:56 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c Jul 03 14:02:56 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:56 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.247s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:56 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:56 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] Deleted volume successfully. Jul 03 14:02:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-69f250a8-d955-466e-9c64-bfd21092fa34 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "cinder-43636d8c-996d-4c4e-91aa-a478eb1d91ab-delete_volume" released by "delete_volume" :: held 3.537s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:57 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20" returned: 0 in 1.302s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:57 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.info Jul 03 14:02:57 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:57 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c" returned: 0 in 1.362s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:57 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c Jul 03 14:02:57 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:02:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:58 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:02:58 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:58 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.info" returned: 0 in 1.177s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:58 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.info is being set with open permissions: ugo+rw Jul 03 14:02:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:58 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.info Jul 03 14:02:58 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:59 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-db6dec1e-b554-4b14-a2de-3fca7dfe052c" returned: 0 in 1.194s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "cinder-quobyte-db6dec1e-b554-4b14-a2de-3fca7dfe052c" released by "delete_volume" :: held 2.650s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:59 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] Created reservations ['f641bba8-69be-40dc-a693-7b5db2800f9a', 'deaf0730-4483-4ff8-b103-a121208c54a6', '42eecc46-36e6-4aeb-a4d5-93b3723dbbc2', 'a1b7f44b-b0db-4b0e-a5b6-54b00f777330'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:59 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:02:59 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:59 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.251s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:59 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.info" returned: 0 in 1.109s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.947s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:59 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-78e85fd1-7679-452e-974f-ea30518c129a tempest-VolumesDeleteCascade-674605090 None] Create snapshot completed successfully Jul 03 14:03:00 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.917s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:00 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:00 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] Deleted volume successfully. Jul 03 14:03:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-667e1676-2bb1-4f47-a7fd-28480eea3c33 tempest-AttachVolumeNegativeTest-1388742330 None] Lock "cinder-db6dec1e-b554-4b14-a2de-3fca7dfe052c-delete_volume" released by "delete_volume" :: held 3.974s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-caa8f87f-9ce3-4014-afbe-26809257aa7d tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-caa8f87f-9ce3-4014-afbe-26809257aa7d tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-caa8f87f-9ce3-4014-afbe-26809257aa7d tempest-VolumesDeleteCascade-674605090 None] Creating offline snapshot 3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45 of volume 150dd3c2-1484-4c92-80f0-bb4fa7077daa {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:03:00 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf510fb-1871-4423-a773-9cfcdd7973fc]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-caa8f87f-9ce3-4014-afbe-26809257aa7d tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:00 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 Jul 03 14:03:00 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:01 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-caa8f87f-9ce3-4014-afbe-26809257aa7d tempest-VolumesDeleteCascade-674605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20" returned: 0 in 1.304s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:01 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-caa8f87f-9ce3-4014-afbe-26809257aa7d tempest-VolumesDeleteCascade-674605090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:03:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-caa8f87f-9ce3-4014-afbe-26809257aa7d tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:01 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45 1G Jul 03 14:03:01 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:03 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-caa8f87f-9ce3-4014-afbe-26809257aa7d tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45 1G" returned: 0 in 1.169s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-caa8f87f-9ce3-4014-afbe-26809257aa7d tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:03 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45 Jul 03 14:03:03 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:03 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:03:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Flow 'volume_create_manager' (ccb96678-206f-4751-8f34-0138359f9073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca4bb84-bb96-4c2f-8a4e-3a6aa490d24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca4bb84-bb96-4c2f-8a4e-3a6aa490d24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1829006255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b48c796-3a93-4104-a3f9-57b0f2697fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92f58b0f8764d23ab4a91d627e47d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:03Z,use_quota=True,user_id='c65011916cf1463b93771c07d9c94444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbe0e9a-e1c0-4365-8e47-9ea7de0c4213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbe0e9a-e1c0-4365-8e47-9ea7de0c4213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b214fb0d-7083-4516-a2cb-f82337b888fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b214fb0d-7083-4516-a2cb-f82337b888fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b48c796-3a93-4104-a3f9-57b0f2697fbc', 'volume_name': 'volume-4b48c796-3a93-4104-a3f9-57b0f2697fbc', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf5952a-3f64-4fec-a5ed-629cb57c2569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf5952a-3f64-4fec-a5ed-629cb57c2569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969caa1c-c61f-40bb-a289-4643c9637170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:03 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Volume 4b48c796-3a93-4104-a3f9-57b0f2697fbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b48c796-3a93-4104-a3f9-57b0f2697fbc', 'volume_size': 1} Jul 03 14:03:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:03 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-caa8f87f-9ce3-4014-afbe-26809257aa7d tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45" returned: 0 in 0.906s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:03 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-caa8f87f-9ce3-4014-afbe-26809257aa7d tempest-VolumesDeleteCascade-674605090 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45 is being set with open permissions: ugo+rw Jul 03 14:03:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-caa8f87f-9ce3-4014-afbe-26809257aa7d tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:03 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45 Jul 03 14:03:03 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:04 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-caa8f87f-9ce3-4014-afbe-26809257aa7d tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45" returned: 0 in 0.774s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-caa8f87f-9ce3-4014-afbe-26809257aa7d tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.303s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.521s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1829006255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b48c796-3a93-4104-a3f9-57b0f2697fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92f58b0f8764d23ab4a91d627e47d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:03Z,use_quota=True,user_id='c65011916cf1463b93771c07d9c94444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:03:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Creating volume 4b48c796-3a93-4104-a3f9-57b0f2697fbc {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:03:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:03:04 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:03:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4b48c796-3a93-4104-a3f9-57b0f2697fbc 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:04 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4b48c796-3a93-4104-a3f9-57b0f2697fbc 1073741824 Jul 03 14:03:04 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:04 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-caa8f87f-9ce3-4014-afbe-26809257aa7d tempest-VolumesDeleteCascade-674605090 None] Create snapshot completed successfully Jul 03 14:03:05 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "cinder-150dd3c2-1484-4c92-80f0-bb4fa7077daa-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:05 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-150dd3c2-1484-4c92-80f0-bb4fa7077daa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:05 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4b48c796-3a93-4104-a3f9-57b0f2697fbc 1073741824" returned: 0 in 1.071s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Performing cascade delete. {{(pid=86805) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 03 14:03:05 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "cinder-3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4b48c796-3a93-4104-a3f9-57b0f2697fbc {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:05 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:05 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4b48c796-3a93-4104-a3f9-57b0f2697fbc Jul 03 14:03:05 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:05 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "cinder-quobyte-150dd3c2-1484-4c92-80f0-bb4fa7077daa" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:05 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-150dd3c2-1484-4c92-80f0-bb4fa7077daa" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:05 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "cinder-quobyte-3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:05 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Deleting offline snapshot 3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45 of volume 150dd3c2-1484-4c92-80f0-bb4fa7077daa {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:03:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] snapshot_file for this snap is: volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:03:06 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35f6f30-a1c2-44a1-a29d-a4db039698a0]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:06 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45 Jul 03 14:03:06 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:06 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4b48c796-3a93-4104-a3f9-57b0f2697fbc" returned: 0 in 0.744s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:03:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969caa1c-c61f-40bb-a289-4643c9637170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b48c796-3a93-4104-a3f9-57b0f2697fbc', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f4ff46-0fd7-4a34-8b98-11fa72b682d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:06 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Volume volume-4b48c796-3a93-4104-a3f9-57b0f2697fbc (4b48c796-3a93-4104-a3f9-57b0f2697fbc): created successfully Jul 03 14:03:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f4ff46-0fd7-4a34-8b98-11fa72b682d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Flow 'volume_create_manager' (ccb96678-206f-4751-8f34-0138359f9073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:06 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-73486198-e1c4-4cad-823f-12dc56b47f53 tempest-VolumesTransfersV355Test-151940061 None] Created volume successfully. Jul 03 14:03:06 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45" returned: 0 in 0.812s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:03:06 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4324bc58-b6aa-4d42-b6f2-568192e8fe01]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:06 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 Jul 03 14:03:06 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:07 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20" returned: 0 in 0.874s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:03:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:07 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45 Jul 03 14:03:07 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:08 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-52ca6f7a-184e-4ab9-8b34-6fb30fdc731d tempest-VolumesTransfersV355Test-903808804 None] Transfer volume completed successfully. Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Flow 'volume_create_manager' (ebcf4200-e5ac-430c-81f9-4447f40ee6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d96300b-943e-4935-b855-d754cc64b8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d96300b-943e-4935-b855-d754cc64b8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1503591876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b437649-ab4e-4cb0-a239-8a7f15b5ef5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e04c2b0553541b09fb6bd3b20eac11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:08Z,use_quota=True,user_id='8c82e731ac154c49b599cc424dfbddf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aeccab5-0b2d-4bd6-8b42-cacc5303a984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aeccab5-0b2d-4bd6-8b42-cacc5303a984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0533eb5-5914-404a-aba7-47c1ef1b3a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0533eb5-5914-404a-aba7-47c1ef1b3a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b437649-ab4e-4cb0-a239-8a7f15b5ef5c', 'volume_name': 'volume-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c660bd6-6dc5-44f2-ab6e-6b52baa3c3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c660bd6-6dc5-44f2-ab6e-6b52baa3c3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03b62af-e106-4f94-a8a6-d9e39b5fc993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:08 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Volume 2b437649-ab4e-4cb0-a239-8a7f15b5ef5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c', 'volume_size': 1} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1503591876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b437649-ab4e-4cb0-a239-8a7f15b5ef5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e04c2b0553541b09fb6bd3b20eac11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:08Z,use_quota=True,user_id='8c82e731ac154c49b599cc424dfbddf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Creating volume 2b437649-ab4e-4cb0-a239-8a7f15b5ef5c {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:03:08 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:08 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c 1073741824 Jul 03 14:03:08 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:08 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45" returned: 0 in 0.884s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:08 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45 Jul 03 14:03:08 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] Acquiring lock "cinder-4b48c796-3a93-4104-a3f9-57b0f2697fbc-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] Lock "cinder-4b48c796-3a93-4104-a3f9-57b0f2697fbc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] Acquiring lock "cinder-quobyte-4b48c796-3a93-4104-a3f9-57b0f2697fbc" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] Lock "cinder-quobyte-4b48c796-3a93-4104-a3f9-57b0f2697fbc" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2485709-0e16-4b63-ba65-914821448a14]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4b48c796-3a93-4104-a3f9-57b0f2697fbc {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:09 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4b48c796-3a93-4104-a3f9-57b0f2697fbc Jul 03 14:03:09 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:09 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45" returned: 0 in 0.706s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45" released by "_delete_snapshot" :: held 3.387s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-150dd3c2-1484-4c92-80f0-bb4fa7077daa" released by "delete_snapshot" :: held 3.424s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:09 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c 1073741824" returned: 0 in 0.998s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Created reservations ['70585393-fe22-42c9-8bf1-2f51b623a210', '1e63727d-a035-4f51-804c-4a7465b9d9df', '78baac2d-eb07-4956-ac97-0333997d5eec', '9c4c1315-eb68-4dd1-a929-ab9442508d52'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:09 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c Jul 03 14:03:09 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:09 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Delete snapshot completed successfully. Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-3e2cf9c9-bfce-4c4b-acae-4d2d2455bd45-delete_snapshot" released by "delete_snapshot" :: held 3.651s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "cinder-69181f4a-2fe3-4b33-b60a-6d2b39dcdd20-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-69181f4a-2fe3-4b33-b60a-6d2b39dcdd20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "cinder-quobyte-150dd3c2-1484-4c92-80f0-bb4fa7077daa" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-150dd3c2-1484-4c92-80f0-bb4fa7077daa" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "cinder-quobyte-69181f4a-2fe3-4b33-b60a-6d2b39dcdd20" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-69181f4a-2fe3-4b33-b60a-6d2b39dcdd20" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Deleting offline snapshot 69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 of volume 150dd3c2-1484-4c92-80f0-bb4fa7077daa {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] snapshot_file for this snap is: volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dcb1f1-6514-491c-ac60-114e6127c6a7]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:09 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 Jul 03 14:03:09 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:10 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4b48c796-3a93-4104-a3f9-57b0f2697fbc" returned: 0 in 0.829s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4b48c796-3a93-4104-a3f9-57b0f2697fbc {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:10 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4b48c796-3a93-4104-a3f9-57b0f2697fbc Jul 03 14:03:10 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:10 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c" returned: 0 in 0.674s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03b62af-e106-4f94-a8a6-d9e39b5fc993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e22cf6a-052d-41ae-9acb-11f3db63c125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:10 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Volume volume-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c (2b437649-ab4e-4cb0-a239-8a7f15b5ef5c): created successfully Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e22cf6a-052d-41ae-9acb-11f3db63c125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Flow 'volume_create_manager' (ebcf4200-e5ac-430c-81f9-4447f40ee6db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:10 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-dacf2080-c9a0-4d47-85a7-400d73adc645 tempest-VolumesTestJSON-922661359 None] Created volume successfully. Jul 03 14:03:10 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20" returned: 0 in 0.839s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60f9f67-da86-4de4-b091-2d967107aaaa]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:10 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa Jul 03 14:03:10 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:10 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4b48c796-3a93-4104-a3f9-57b0f2697fbc" returned: 0 in 0.671s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] Lock "cinder-quobyte-4b48c796-3a93-4104-a3f9-57b0f2697fbc" released by "delete_volume" :: held 1.546s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] Created reservations ['df40a894-6271-44e8-acf0-05b872966a6b', '88cf44b5-527f-4d9a-ba1f-0e021e80a937', 'c18ed900-9560-47d9-8591-774c2d1380ca', 'eab949b6-66a8-4c76-b684-deda76719d14'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:10 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:03:10 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Flow 'volume_create_manager' (2e415291-a1b3-4d78-a617-ecb38e58cb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78d0177-a6fc-4d23-8d13-bc97306d2a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78d0177-a6fc-4d23-8d13-bc97306d2a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2023920012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=246bd441-32d5-40a3-9c5e-22a195779acc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e04c2b0553541b09fb6bd3b20eac11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:11Z,use_quota=True,user_id='8c82e731ac154c49b599cc424dfbddf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e466f2b5-e5cf-40e3-bfaf-e48c51aac496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e466f2b5-e5cf-40e3-bfaf-e48c51aac496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b361ab-919f-46c4-9097-a3ee0e8e7af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b361ab-919f-46c4-9097-a3ee0e8e7af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '246bd441-32d5-40a3-9c5e-22a195779acc', 'volume_name': 'volume-246bd441-32d5-40a3-9c5e-22a195779acc', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a30bbaa-063e-42ca-8e86-bec5d71d9e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a30bbaa-063e-42ca-8e86-bec5d71d9e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da4be651-3ffc-448e-b36b-88d4e0ec0cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:11 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Volume 246bd441-32d5-40a3-9c5e-22a195779acc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-246bd441-32d5-40a3-9c5e-22a195779acc', 'volume_size': 1} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2023920012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=246bd441-32d5-40a3-9c5e-22a195779acc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e04c2b0553541b09fb6bd3b20eac11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:11Z,use_quota=True,user_id='8c82e731ac154c49b599cc424dfbddf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Creating volume 246bd441-32d5-40a3-9c5e-22a195779acc {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:03:11 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-246bd441-32d5-40a3-9c5e-22a195779acc 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:11 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-246bd441-32d5-40a3-9c5e-22a195779acc 1073741824 Jul 03 14:03:11 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:11 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa" returned: 0 in 0.934s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:11 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 Jul 03 14:03:11 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:11 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.779s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:11 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] Deleted volume successfully. Jul 03 14:03:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-77b29c8f-3869-4447-b146-8ec3e2767d15 tempest-VolumesTransfersV355Test-860562691 None] Lock "cinder-4b48c796-3a93-4104-a3f9-57b0f2697fbc-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Flow 'volume_create_manager' (815f815e-e16a-423e-8c15-cec4c7ae2194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (887d9f18-7915-4ce6-b683-d3fd14cae2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (887d9f18-7915-4ce6-b683-d3fd14cae2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1116351518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db3e5ec-1544-48fc-b188-69ccd489d648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92f58b0f8764d23ab4a91d627e47d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:12Z,use_quota=True,user_id='c65011916cf1463b93771c07d9c94444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016e3ef2-4e8c-4b09-817a-00362265839d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016e3ef2-4e8c-4b09-817a-00362265839d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ce6453-a949-4cc9-bd21-095d35a68238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ce6453-a949-4cc9-bd21-095d35a68238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1db3e5ec-1544-48fc-b188-69ccd489d648', 'volume_name': 'volume-1db3e5ec-1544-48fc-b188-69ccd489d648', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1ba329-a401-4828-9e5a-d1e0d5a5e3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1ba329-a401-4828-9e5a-d1e0d5a5e3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8360bd-64ac-4da7-b182-f640b9c89750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:12 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Volume 1db3e5ec-1544-48fc-b188-69ccd489d648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1db3e5ec-1544-48fc-b188-69ccd489d648', 'volume_size': 1} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:12 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-246bd441-32d5-40a3-9c5e-22a195779acc 1073741824" returned: 0 in 0.979s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-246bd441-32d5-40a3-9c5e-22a195779acc {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:12 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-246bd441-32d5-40a3-9c5e-22a195779acc Jul 03 14:03:12 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:12 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20" returned: 0 in 0.889s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:12 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20 Jul 03 14:03:12 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:12 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-246bd441-32d5-40a3-9c5e-22a195779acc" returned: 0 in 0.730s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.836s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1116351518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db3e5ec-1544-48fc-b188-69ccd489d648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92f58b0f8764d23ab4a91d627e47d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:12Z,use_quota=True,user_id='c65011916cf1463b93771c07d9c94444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Creating volume 1db3e5ec-1544-48fc-b188-69ccd489d648 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:03:12 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1db3e5ec-1544-48fc-b188-69ccd489d648 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:12 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1db3e5ec-1544-48fc-b188-69ccd489d648 1073741824 Jul 03 14:03:12 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da4be651-3ffc-448e-b36b-88d4e0ec0cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-246bd441-32d5-40a3-9c5e-22a195779acc', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2efa6c35-6e49-4079-bc61-6753881bf1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:13 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Volume volume-246bd441-32d5-40a3-9c5e-22a195779acc (246bd441-32d5-40a3-9c5e-22a195779acc): created successfully Jul 03 14:03:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2efa6c35-6e49-4079-bc61-6753881bf1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Flow 'volume_create_manager' (2e415291-a1b3-4d78-a617-ecb38e58cb85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:13 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-dbc6de88-4af7-4287-8472-27ca126d528c tempest-VolumesTestJSON-922661359 None] Created volume successfully. Jul 03 14:03:13 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa.69181f4a-2fe3-4b33-b60a-6d2b39dcdd20" returned: 0 in 0.751s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-69181f4a-2fe3-4b33-b60a-6d2b39dcdd20" released by "_delete_snapshot" :: held 3.523s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-150dd3c2-1484-4c92-80f0-bb4fa7077daa" released by "delete_snapshot" :: held 3.555s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:13 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Created reservations ['35d44008-ef1a-4b4b-9bdb-2525ea9d0eb5', 'e44601c9-be03-48f0-b135-126022d00908', '2f0adf94-eade-484f-9faa-b092746866a0', '08005e38-7e5b-4876-a804-376363febb09'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:13 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Delete snapshot completed successfully. Jul 03 14:03:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-69181f4a-2fe3-4b33-b60a-6d2b39dcdd20-delete_snapshot" released by "delete_snapshot" :: held 3.727s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Snapshots deleted, issuing volume delete {{(pid=86805) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 03 14:03:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "cinder-quobyte-150dd3c2-1484-4c92-80f0-bb4fa7077daa" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-150dd3c2-1484-4c92-80f0-bb4fa7077daa" acquired by "delete_volume" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:13 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56e1c4c-13d9-4c48-9eb1-55b9fa46d003]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:13 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa Jul 03 14:03:13 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:13 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1db3e5ec-1544-48fc-b188-69ccd489d648 1073741824" returned: 0 in 0.990s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1db3e5ec-1544-48fc-b188-69ccd489d648 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:13 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1db3e5ec-1544-48fc-b188-69ccd489d648 Jul 03 14:03:13 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:14 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa" returned: 0 in 0.818s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:14 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa Jul 03 14:03:14 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:14 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1db3e5ec-1544-48fc-b188-69ccd489d648" returned: 0 in 0.736s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8360bd-64ac-4da7-b182-f640b9c89750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1db3e5ec-1544-48fc-b188-69ccd489d648', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8151ae2b-00f6-4625-8802-77dec87f105d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:14 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Volume volume-1db3e5ec-1544-48fc-b188-69ccd489d648 (1db3e5ec-1544-48fc-b188-69ccd489d648): created successfully Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8151ae2b-00f6-4625-8802-77dec87f105d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Flow 'volume_create_manager' (815f815e-e16a-423e-8c15-cec4c7ae2194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:14 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-dcb1af29-faa5-4e3f-af00-7d1fc56a5109 tempest-VolumesTransfersV355Test-151940061 None] Created volume successfully. Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Flow 'volume_create_manager' (e9653c0c-8845-4514-93a1-4016b275768c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c40a5f3-83b3-4457-a42d-4257195f5bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c40a5f3-83b3-4457-a42d-4257195f5bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1179088015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117b671f-ea19-4c0a-aa5b-5ff168fa5638,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e04c2b0553541b09fb6bd3b20eac11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:15Z,use_quota=True,user_id='8c82e731ac154c49b599cc424dfbddf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fc304c-4368-4389-a718-3daaced487c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fc304c-4368-4389-a718-3daaced487c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239a71ff-31ee-4b76-a790-e06c4d0e5d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239a71ff-31ee-4b76-a790-e06c4d0e5d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117b671f-ea19-4c0a-aa5b-5ff168fa5638', 'volume_name': 'volume-117b671f-ea19-4c0a-aa5b-5ff168fa5638', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3534be-37e4-4c1e-aa82-3898b23fab2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3534be-37e4-4c1e-aa82-3898b23fab2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8f6ae6-ea72-465d-95cd-0a4737fa0bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:14 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Volume 117b671f-ea19-4c0a-aa5b-5ff168fa5638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117b671f-ea19-4c0a-aa5b-5ff168fa5638', 'volume_size': 1} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1179088015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117b671f-ea19-4c0a-aa5b-5ff168fa5638,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e04c2b0553541b09fb6bd3b20eac11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:15Z,use_quota=True,user_id='8c82e731ac154c49b599cc424dfbddf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Creating volume 117b671f-ea19-4c0a-aa5b-5ff168fa5638 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:03:14 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-117b671f-ea19-4c0a-aa5b-5ff168fa5638 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:14 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-117b671f-ea19-4c0a-aa5b-5ff168fa5638 1073741824 Jul 03 14:03:14 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:14 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-150dd3c2-1484-4c92-80f0-bb4fa7077daa" returned: 0 in 0.796s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-150dd3c2-1484-4c92-80f0-bb4fa7077daa" released by "delete_volume" :: held 1.683s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:15 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Created reservations ['589b2f55-a006-4218-9be2-fcf74df16dfa', 'bbb8973a-ac05-42e9-be9c-1bd84d42c382', '24e961c0-0467-4ca2-8cd8-b41d9be4bb04', '44a9b2d2-93c4-4b29-941f-4aa53a934423'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:15 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:03:15 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] Acquiring lock "cinder-1db3e5ec-1544-48fc-b188-69ccd489d648-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] Lock "cinder-1db3e5ec-1544-48fc-b188-69ccd489d648-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] Acquiring lock "cinder-quobyte-1db3e5ec-1544-48fc-b188-69ccd489d648" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] Lock "cinder-quobyte-1db3e5ec-1544-48fc-b188-69ccd489d648" acquired by "delete_volume" :: waited 0.029s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:15 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0348c152-6976-420c-84a3-510b549c77d4]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1db3e5ec-1544-48fc-b188-69ccd489d648 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:16 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.946s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:16 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:16 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Deleted volume successfully. Jul 03 14:03:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-8165781c-b54d-46f6-8ea6-132bd3a0fe62 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-150dd3c2-1484-4c92-80f0-bb4fa7077daa-delete_volume" released by "delete_volume" :: held 10.325s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:16 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1db3e5ec-1544-48fc-b188-69ccd489d648 Jul 03 14:03:16 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:16 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-117b671f-ea19-4c0a-aa5b-5ff168fa5638 1073741824" returned: 0 in 1.468s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-117b671f-ea19-4c0a-aa5b-5ff168fa5638 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:16 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-117b671f-ea19-4c0a-aa5b-5ff168fa5638 Jul 03 14:03:16 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:16 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:03:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Flow 'volume_create_manager' (7526abe0-7b37-4976-a317-a69cb3d9e3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845ef2fd-fd15-4478-83f5-5db745cee48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845ef2fd-fd15-4478-83f5-5db745cee48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-563392269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33a509f-d839-4a1f-acb2-c47ecb4f1774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27da513c2204801bb57aba77088c901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:17Z,use_quota=True,user_id='b600028c74e14931947a11946bd79d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234dab72-9291-400e-8a49-be76f5efcccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234dab72-9291-400e-8a49-be76f5efcccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191ebc28-6e65-4e1c-9d36-5350717cb83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191ebc28-6e65-4e1c-9d36-5350717cb83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f33a509f-d839-4a1f-acb2-c47ecb4f1774', 'volume_name': 'volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5552b591-17ef-4bc6-bc94-4f6976dae291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5552b591-17ef-4bc6-bc94-4f6976dae291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9a3508-5f5e-4a4f-b037-c5ed6fec843b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:16 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Volume f33a509f-d839-4a1f-acb2-c47ecb4f1774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774', 'volume_size': 1} Jul 03 14:03:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:17 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1db3e5ec-1544-48fc-b188-69ccd489d648" returned: 0 in 1.182s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1db3e5ec-1544-48fc-b188-69ccd489d648 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:17 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1db3e5ec-1544-48fc-b188-69ccd489d648 Jul 03 14:03:17 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:17 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-117b671f-ea19-4c0a-aa5b-5ff168fa5638" returned: 0 in 0.981s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] <== create_volume: return (2517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.519s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.583s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-563392269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33a509f-d839-4a1f-acb2-c47ecb4f1774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27da513c2204801bb57aba77088c901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:17Z,use_quota=True,user_id='b600028c74e14931947a11946bd79d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Creating volume f33a509f-d839-4a1f-acb2-c47ecb4f1774 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:03:17 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8f6ae6-ea72-465d-95cd-0a4737fa0bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117b671f-ea19-4c0a-aa5b-5ff168fa5638', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:17 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 1073741824 Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f332e50e-7df3-4381-8e1b-f3784e949a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:17 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:17 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Volume volume-117b671f-ea19-4c0a-aa5b-5ff168fa5638 (117b671f-ea19-4c0a-aa5b-5ff168fa5638): created successfully Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f332e50e-7df3-4381-8e1b-f3784e949a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Flow 'volume_create_manager' (e9653c0c-8845-4514-93a1-4016b275768c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:17 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-6e783882-68eb-40f0-bd83-9a3208ba7342 tempest-VolumesTestJSON-922661359 None] Created volume successfully. Jul 03 14:03:18 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1db3e5ec-1544-48fc-b188-69ccd489d648" returned: 0 in 1.258s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] Lock "cinder-quobyte-1db3e5ec-1544-48fc-b188-69ccd489d648" released by "delete_volume" :: held 2.519s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:18 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] Created reservations ['822449b1-de69-432f-9dd4-0d02e45f8654', '0fe6c414-2daa-404b-a0cf-9c59e9d84966', '8c5b7973-d1c7-431c-b402-d5835ae28ec2', '2f65125b-1fce-4733-8273-32419d6260d5'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:18 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:03:18 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:19 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 1073741824" returned: 0 in 1.574s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:19 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 Jul 03 14:03:19 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] Acquiring lock "cinder-117b671f-ea19-4c0a-aa5b-5ff168fa5638-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] Lock "cinder-117b671f-ea19-4c0a-aa5b-5ff168fa5638-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] Acquiring lock "cinder-quobyte-117b671f-ea19-4c0a-aa5b-5ff168fa5638" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] Lock "cinder-quobyte-117b671f-ea19-4c0a-aa5b-5ff168fa5638" acquired by "delete_volume" :: waited 0.036s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:19 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c6e055-2c9b-49fe-81b8-7f4b507faefb]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-117b671f-ea19-4c0a-aa5b-5ff168fa5638 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:19 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-117b671f-ea19-4c0a-aa5b-5ff168fa5638 Jul 03 14:03:19 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:20 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.375s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:20 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:20 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] Deleted volume successfully. Jul 03 14:03:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fc62e4c8-4c1e-46fc-848d-282eddd63fff tempest-VolumesTransfersV355Test-860562691 None] Lock "cinder-1db3e5ec-1544-48fc-b188-69ccd489d648-delete_volume" released by "delete_volume" :: held 4.304s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:20 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774" returned: 0 in 1.155s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] <== create_volume: return (2785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:03:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.789s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9a3508-5f5e-4a4f-b037-c5ed6fec843b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7610b712-ef38-48fe-9af3-035e8408bdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:20 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Volume volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 (f33a509f-d839-4a1f-acb2-c47ecb4f1774): created successfully Jul 03 14:03:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7610b712-ef38-48fe-9af3-035e8408bdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Flow 'volume_create_manager' (7526abe0-7b37-4976-a317-a69cb3d9e3d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:20 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-5a5d5081-2b47-4d9d-8c85-89b474343101 tempest-VolumesDeleteCascade-674605090 None] Created volume successfully. Jul 03 14:03:20 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-117b671f-ea19-4c0a-aa5b-5ff168fa5638" returned: 0 in 1.117s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-117b671f-ea19-4c0a-aa5b-5ff168fa5638 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:20 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-117b671f-ea19-4c0a-aa5b-5ff168fa5638 Jul 03 14:03:20 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] Creating offline snapshot ce5643b7-40e9-4faa-8dee-37f7c7423abe of volume f33a509f-d839-4a1f-acb2-c47ecb4f1774 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:03:21 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1e1115-3bb8-4abd-b9d9-6892e9874910]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:21 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-117b671f-ea19-4c0a-aa5b-5ff168fa5638" returned: 0 in 0.828s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] Lock "cinder-quobyte-117b671f-ea19-4c0a-aa5b-5ff168fa5638" released by "delete_volume" :: held 2.038s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:21 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] Created reservations ['efaab589-27e0-45d5-9006-54bfdfc5bc30', '446c12c6-1aa8-4ff7-a746-e0dd3b0bd654', '5a8540a1-8bd7-4c30-83aa-a8f7bd7d798b', '61377982-0ea2-42cc-94b8-aba121819a82'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:21 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 Jul 03 14:03:21 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:21 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:03:21 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] Acquiring lock "cinder-246bd441-32d5-40a3-9c5e-22a195779acc-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] Lock "cinder-246bd441-32d5-40a3-9c5e-22a195779acc-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] Acquiring lock "cinder-quobyte-246bd441-32d5-40a3-9c5e-22a195779acc" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] Lock "cinder-quobyte-246bd441-32d5-40a3-9c5e-22a195779acc" acquired by "delete_volume" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:22 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3805b1-2535-4a6c-93d5-22c37a6b71e1]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-246bd441-32d5-40a3-9c5e-22a195779acc {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:22 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-246bd441-32d5-40a3-9c5e-22a195779acc Jul 03 14:03:22 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:22 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.068s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:22 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:22 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] Deleted volume successfully. Jul 03 14:03:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-700f5206-5c86-40c9-8bf2-6aa9c3850d26 tempest-VolumesTestJSON-922661359 None] Lock "cinder-117b671f-ea19-4c0a-aa5b-5ff168fa5638-delete_volume" released by "delete_volume" :: held 3.525s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:23 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774" returned: 0 in 1.540s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:23 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe 1G Jul 03 14:03:23 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:23 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-246bd441-32d5-40a3-9c5e-22a195779acc" returned: 0 in 1.237s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-246bd441-32d5-40a3-9c5e-22a195779acc {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:23 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-246bd441-32d5-40a3-9c5e-22a195779acc Jul 03 14:03:23 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:24 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe 1G" returned: 0 in 1.047s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:24 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe Jul 03 14:03:24 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:24 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-246bd441-32d5-40a3-9c5e-22a195779acc" returned: 0 in 0.906s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] Lock "cinder-quobyte-246bd441-32d5-40a3-9c5e-22a195779acc" released by "delete_volume" :: held 2.244s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:24 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] Created reservations ['78c0f65c-36a7-4a3b-bb27-6867f780f15a', 'bc8280b2-fa9f-44ae-876b-3e0dc4ec1a74', '30ee5cfb-f99e-4677-831e-83cbef69549f', 'c82e5790-23b2-4661-8179-9c02dea5d9fc'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:24 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:03:24 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:25 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe" returned: 0 in 0.894s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:25 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe is being set with open permissions: ugo+rw Jul 03 14:03:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:25 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe Jul 03 14:03:25 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] Acquiring lock "cinder-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] Lock "cinder-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] Acquiring lock "cinder-quobyte-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:25 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.059s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:25 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] Lock "cinder-quobyte-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c" acquired by "delete_volume" :: waited 0.037s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:25 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe" returned: 0 in 0.728s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:25 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] Deleted volume successfully. Jul 03 14:03:25 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[829400bf-ae7d-4708-90ad-b2bf0e606c11]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ac28e411-a6c6-49c1-834b-7a75849e1f56 tempest-VolumesTestJSON-922661359 None] Lock "cinder-246bd441-32d5-40a3-9c5e-22a195779acc-delete_volume" released by "delete_volume" :: held 3.880s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:25 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.info Jul 03 14:03:25 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:26 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c Jul 03 14:03:26 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:26 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.info" returned: 0 in 0.805s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:26 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.info is being set with open permissions: ugo+rw Jul 03 14:03:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:26 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.info Jul 03 14:03:26 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:26 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c" returned: 0 in 1.127s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:26 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c Jul 03 14:03:26 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:27 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.info" returned: 0 in 0.797s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.964s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:27 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-846c5a32-81da-4648-9ab1-05b5be72131f tempest-VolumesDeleteCascade-674605090 None] Create snapshot completed successfully Jul 03 14:03:27 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c" returned: 0 in 0.757s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] Lock "cinder-quobyte-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c" released by "delete_volume" :: held 1.933s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:27 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] Created reservations ['b8da11a1-58d7-401e-8d46-276ff740a8ee', 'cdf8ae40-33fe-45f2-8338-618751d3bb02', 'b0f553ed-ec35-4648-aa75-c179b342dba4', '4b671a4e-11c5-426a-99b8-141b78a011c8'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:27 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:03:27 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:28 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:03:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Flow 'volume_create_manager' (23912372-1a49-4174-83c9-74e493024adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfca2ca-a93b-4a49-998e-7c30041d2286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfca2ca-a93b-4a49-998e-7c30041d2286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-145944624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb7baa0-8e09-495b-9ebf-5997fa8ceef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b71b097d7c845a28a41aa3b68f68db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:28Z,use_quota=True,user_id='737deacf114a46eca61a5726eb7fcc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c50478-f6aa-4a1d-a103-98575074a6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c50478-f6aa-4a1d-a103-98575074a6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0afc71d-4ee6-4b6a-8b84-30b890d8dc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:28 devstack cinder-volume[86805]: DEBUG cinder.image.glance [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Creating Keystone auth plugin from conf {{(pid=86805) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 14:03:28 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.904s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:28 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] Deleted volume successfully. Jul 03 14:03:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d244f1a1-c3a1-4f55-8d53-c51942ae61c5 tempest-VolumesTestJSON-922661359 None] Lock "cinder-2b437649-ab4e-4cb0-a239-8a7f15b5ef5c-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:28 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:03:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Flow 'volume_create_manager' (b3cf41a9-d868-40de-a1a5-8d692824d6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d2f20b-8179-4c4f-af3c-679b63241c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d2f20b-8179-4c4f-af3c-679b63241c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-935925363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c8e872-c030-4f1d-9bac-dff336561927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27da513c2204801bb57aba77088c901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ce5643b7-40e9-4faa-8dee-37f7c7423abe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:29Z,use_quota=True,user_id='b600028c74e14931947a11946bd79d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c4c09c-2696-4975-bb94-3b6f56a373ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c4c09c-2696-4975-bb94-3b6f56a373ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241229e9-6539-415e-9616-a6c552a92cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241229e9-6539-415e-9616-a6c552a92cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a8c8e872-c030-4f1d-9bac-dff336561927', 'volume_name': 'volume-a8c8e872-c030-4f1d-9bac-dff336561927', 'volume_size': 1, 'snapshot_id': 'ce5643b7-40e9-4faa-8dee-37f7c7423abe'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde22bc9-233e-4ce4-938f-892983360ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde22bc9-233e-4ce4-938f-892983360ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524bf712-aaab-4724-bcd8-d350e5bd3182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:29 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Volume a8c8e872-c030-4f1d-9bac-dff336561927: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a8c8e872-c030-4f1d-9bac-dff336561927', 'volume_size': 1, 'snapshot_id': 'ce5643b7-40e9-4faa-8dee-37f7c7423abe'} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "cinder-quobyte-ce5643b7-40e9-4faa-8dee-37f7c7423abe-a8c8e872-c030-4f1d-9bac-dff336561927" by "_create_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-ce5643b7-40e9-4faa-8dee-37f7c7423abe-a8c8e872-c030-4f1d-9bac-dff336561927" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Creating volume a8c8e872-c030-4f1d-9bac-dff336561927 from snapshot ce5643b7-40e9-4faa-8dee-37f7c7423abe {{(pid=86805) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "cinder-quobyte-a8c8e872-c030-4f1d-9bac-dff336561927" by "_copy_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-a8c8e872-c030-4f1d-9bac-dff336561927" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] snapshot: ce5643b7-40e9-4faa-8dee-37f7c7423abe, volume: a8c8e872-c030-4f1d-9bac-dff336561927, {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4b7fbc-ad95-4f68-844f-958d4011a1be]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:29 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe Jul 03 14:03:29 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0afc71d-4ee6-4b6a-8b84-30b890d8dc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8bb7baa0-8e09-495b-9ebf-5997fa8ceef5', 'volume_name': 'volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5', 'volume_size': 1, 'image_id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '50c6afe76f7e4b1c8c512d52058b3c26', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'created_at': datetime.datetime(2026, 7, 3, 11, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14be8f8b-de0c-4029-a83f-c66e4cebc518/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c097984d-c5d5-4279-bd07-a30286d78cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c097984d-c5d5-4279-bd07-a30286d78cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f005e4-371b-465c-a870-1ba04b66a6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:29 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Volume 8bb7baa0-8e09-495b-9ebf-5997fa8ceef5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5', 'volume_size': 1, 'image_id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '50c6afe76f7e4b1c8c512d52058b3c26', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'created_at': datetime.datetime(2026, 7, 3, 11, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14be8f8b-de0c-4029-a83f-c66e4cebc518/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 14:03:29 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Trying to clone 8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 from image 14be8f8b-de0c-4029-a83f-c66e4cebc518 at location (None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}]). {{(pid=86805) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 14:03:30 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_h3jdkt3vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 14:03:30 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Image download 20.69 MB at 20.69 MB/s Jul 03 14:03:30 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3b32fa-b816-4971-9584-8ea160192ed1]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_h3jdkt3vdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:30 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe" returned: 0 in 1.114s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:30 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:03:30 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] will copy from snapshot at /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 14:03:30 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Creating direct copy from snapshot {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 14:03:30 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13fdfbf-8c5a-4472-b602-35ee1147b115]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:30 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_h3jdkt3vdevstack@QuobyteHD Jul 03 14:03:30 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:30 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 Jul 03 14:03:30 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:31 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_h3jdkt3vdevstack@QuobyteHD" returned: 0 in 0.981s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:31 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Temporary image 14be8f8b-de0c-4029-a83f-c66e4cebc518 is fetched for user 737deacf114a46eca61a5726eb7fcc59. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 14:03:31 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774" returned: 0 in 1.028s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:31 devstack cinder-volume[86805]: DEBUG cinder.utils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Path /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8c8e872-c030-4f1d-9bac-dff336561927 not found in is_blk_device check {{(pid=86805) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 14:03:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8c8e872-c030-4f1d-9bac-dff336561927 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:31 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b0fe41-5865-4f42-bd4a-05ec05cf9be1]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_h3jdkt3vdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:31 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8c8e872-c030-4f1d-9bac-dff336561927 Jul 03 14:03:31 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:31 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_h3jdkt3vdevstack@QuobyteHD Jul 03 14:03:31 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:32 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_h3jdkt3vdevstack@QuobyteHD" returned: 0 in 1.077s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4f287ecd-ccc7-46ab-8222-fb6071f14cd4 tempest-GroupSnapshotsV319Test-2110497302 None] Group tempest-GroupSnapshotsV319Test-Group-814807645: creating Jul 03 14:03:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4f287ecd-ccc7-46ab-8222-fb6071f14cd4 tempest-GroupSnapshotsV319Test-2110497302 None] Group tempest-GroupSnapshotsV319Test-Group-814807645: created successfully Jul 03 14:03:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4f287ecd-ccc7-46ab-8222-fb6071f14cd4 tempest-GroupSnapshotsV319Test-2110497302 None] Create group completed successfully. Jul 03 14:03:36 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8c8e872-c030-4f1d-9bac-dff336561927" returned: 0 in 5.314s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:36 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[383cc5e0-24ad-41df-b2d0-8aa4faeba454]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:36 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:03:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Flow 'volume_create_manager' (e111c007-e5d8-467f-9baa-9e609eb0416a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a4222a-891c-4f22-bfc2-f989c47c7563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a4222a-891c-4f22-bfc2-f989c47c7563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1692188233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c98c3d34-629c-45e9-831c-c5436cb3a4ba,host='devstack@QuobyteHD#QuobyteHD',id=3a4d2307-4242-4101-8963-0e1686831709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f47efce746e49b98f5ae712eab3fa02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:37Z,use_quota=True,user_id='a91543e8d8c844e19d7ce5ff86a694c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02cd6e4c-045a-4964-bee5-6909c2cb7d41),volume_type_id=02cd6e4c-045a-4964-bee5-6909c2cb7d41)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:36 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 Jul 03 14:03:36 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07a5a94-3c23-4575-80c2-ab991fe0d7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07a5a94-3c23-4575-80c2-ab991fe0d7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0611c33-fc8e-4e82-aa28-b0f39311959d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0611c33-fc8e-4e82-aa28-b0f39311959d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a4d2307-4242-4101-8963-0e1686831709', 'volume_name': 'volume-3a4d2307-4242-4101-8963-0e1686831709', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdd6f40-03ab-4049-9f3b-619498de4bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdd6f40-03ab-4049-9f3b-619498de4bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfd5569-060c-4608-82f1-87d1fbc0221e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:36 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Volume 3a4d2307-4242-4101-8963-0e1686831709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a4d2307-4242-4101-8963-0e1686831709', 'volume_size': 1} Jul 03 14:03:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:37 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774" returned: 0 in 0.898s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:37 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Image conversion details: src /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8c8e872-c030-4f1d-9bac-dff336561927 {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:03:37 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Converted 1024.00 MB image at 192.66 MB/s Jul 03 14:03:37 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8c8e872-c030-4f1d-9bac-dff336561927 is being set with open permissions: ugo+rw Jul 03 14:03:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8c8e872-c030-4f1d-9bac-dff336561927 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:37 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8c8e872-c030-4f1d-9bac-dff336561927 Jul 03 14:03:37 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:38 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8c8e872-c030-4f1d-9bac-dff336561927" returned: 0 in 0.664s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-a8c8e872-c030-4f1d-9bac-dff336561927" released by "_copy_volume_from_snapshot" :: held 9.171s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-ce5643b7-40e9-4faa-8dee-37f7c7423abe-a8c8e872-c030-4f1d-9bac-dff336561927" released by "_create_volume_from_snapshot" :: held 9.227s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.251s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.804s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-145944624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb7baa0-8e09-495b-9ebf-5997fa8ceef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b71b097d7c845a28a41aa3b68f68db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:28Z,use_quota=True,user_id='737deacf114a46eca61a5726eb7fcc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Creating volume 8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:03:38 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:38 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 1073741824 Jul 03 14:03:38 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524bf712-aaab-4724-bcd8-d350e5bd3182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8c8e872-c030-4f1d-9bac-dff336561927', 'volume_size': 1, 'snapshot_id': 'ce5643b7-40e9-4faa-8dee-37f7c7423abe'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51a9f39-ee58-4c9e-9b74-f3cdf4b00e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:38 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Volume volume-a8c8e872-c030-4f1d-9bac-dff336561927 (a8c8e872-c030-4f1d-9bac-dff336561927): created successfully Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51a9f39-ee58-4c9e-9b74-f3cdf4b00e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Flow 'volume_create_manager' (b3cf41a9-d868-40de-a1a5-8d692824d6ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:38 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-00f2a490-7afa-4e4b-8e7f-d011df114031 tempest-VolumesDeleteCascade-674605090 None] Created volume successfully. Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "cinder-f33a509f-d839-4a1f-acb2-c47ecb4f1774-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-f33a509f-d839-4a1f-acb2-c47ecb4f1774-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Performing cascade delete. {{(pid=86805) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 03 14:03:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "cinder-ce5643b7-40e9-4faa-8dee-37f7c7423abe-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-ce5643b7-40e9-4faa-8dee-37f7c7423abe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "cinder-quobyte-f33a509f-d839-4a1f-acb2-c47ecb4f1774" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-f33a509f-d839-4a1f-acb2-c47ecb4f1774" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "cinder-quobyte-ce5643b7-40e9-4faa-8dee-37f7c7423abe" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-ce5643b7-40e9-4faa-8dee-37f7c7423abe" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Deleting offline snapshot ce5643b7-40e9-4faa-8dee-37f7c7423abe of volume f33a509f-d839-4a1f-acb2-c47ecb4f1774 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:03:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] snapshot_file for this snap is: volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:03:39 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc5b2e0-3e9e-41cc-a75c-d9844637756f]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:39 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe Jul 03 14:03:39 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:39 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 1073741824" returned: 0 in 1.037s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:39 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 Jul 03 14:03:39 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:39 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe" returned: 0 in 0.806s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:03:39 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a971dd3d-70dc-464a-98e0-da36723c3133]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:40 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5" returned: 0 in 0.659s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.168s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c98c3d34-629c-45e9-831c-c5436cb3a4ba,created_at=2026-07-03T12:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1692188233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c98c3d34-629c-45e9-831c-c5436cb3a4ba,host='devstack@QuobyteHD#QuobyteHD',id=3a4d2307-4242-4101-8963-0e1686831709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f47efce746e49b98f5ae712eab3fa02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:37Z,use_quota=True,user_id='a91543e8d8c844e19d7ce5ff86a694c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02cd6e4c-045a-4964-bee5-6909c2cb7d41),volume_type_id=02cd6e4c-045a-4964-bee5-6909c2cb7d41)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Creating volume 3a4d2307-4242-4101-8963-0e1686831709 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:03:40 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:40 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709 1073741824 Jul 03 14:03:40 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:40 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 Jul 03 14:03:40 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Attempting download of 14be8f8b-de0c-4029-a83f-c66e4cebc518 ((None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}])) to volume 8bb7baa0-8e09-495b-9ebf-5997fa8ceef5. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43414ea-ec06-411a-90e6-43414f3560d5]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_u_nvscft {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:40 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_u_nvscft Jul 03 14:03:40 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:40 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774" returned: 0 in 0.822s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:40 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe Jul 03 14:03:40 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:40 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_u_nvscft" returned: 0 in 0.776s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_u_nvscft {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:40 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709 1073741824" returned: 0 in 0.888s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:41 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709 Jul 03 14:03:41 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:41 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_u_nvscft Jul 03 14:03:41 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:41 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe" returned: 0 in 0.884s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:41 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe Jul 03 14:03:41 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:41 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709" returned: 0 in 0.763s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:03:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfd5569-060c-4608-82f1-87d1fbc0221e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a4d2307-4242-4101-8963-0e1686831709', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:41 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aeb211e-7eef-4b46-b904-c1497d99dde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_u_nvscft" returned: 1 in 0.848s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_u_nvscft' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:03:41 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97ba1e4-70c2-4fc0-bcd8-eedb49fc9268]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_h3jdkt3vdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:41 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Volume volume-3a4d2307-4242-4101-8963-0e1686831709 (3a4d2307-4242-4101-8963-0e1686831709): created successfully Jul 03 14:03:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aeb211e-7eef-4b46-b904-c1497d99dde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Flow 'volume_create_manager' (e111c007-e5d8-467f-9baa-9e609eb0416a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:41 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ed439a6f-1980-4e8c-ac3f-b468c6416595 tempest-GroupSnapshotsV319Test-2110497302 None] Created volume successfully. Jul 03 14:03:41 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_h3jdkt3vdevstack@QuobyteHD Jul 03 14:03:41 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:42 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774.ce5643b7-40e9-4faa-8dee-37f7c7423abe" returned: 0 in 0.738s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-ce5643b7-40e9-4faa-8dee-37f7c7423abe" released by "_delete_snapshot" :: held 3.365s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-f33a509f-d839-4a1f-acb2-c47ecb4f1774" released by "delete_snapshot" :: held 3.393s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:42 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Created reservations ['fce49060-de17-4a59-8640-66dbd5b3763c', 'a2fe1118-6f86-4ad0-8ca7-88a6489890cf', '8ab910a1-6cf1-4522-b6e2-ed9cc7691e65', 'a8ec2f0b-afe2-444c-8b6d-7b2189e29d1e'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:42 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Delete snapshot completed successfully. Jul 03 14:03:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-ce5643b7-40e9-4faa-8dee-37f7c7423abe-delete_snapshot" released by "delete_snapshot" :: held 3.596s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Snapshots deleted, issuing volume delete {{(pid=86805) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 03 14:03:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "cinder-quobyte-f33a509f-d839-4a1f-acb2-c47ecb4f1774" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-f33a509f-d839-4a1f-acb2-c47ecb4f1774" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:42 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_h3jdkt3vdevstack@QuobyteHD" returned: 0 in 0.915s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:42 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] 14be8f8b-de0c-4029-a83f-c66e4cebc518 was qcow2, converting to raw {{(pid=86805) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 14:03:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_h3jdkt3vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:42 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[881c94d3-7566-48d0-b956-f845cd5de5d7]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:42 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_h3jdkt3vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 Jul 03 14:03:42 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:42 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 Jul 03 14:03:42 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:43 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] GroupSnapshot d5abc7d0-67f4-4155-98aa-d7c52da9cdd4: creating. Jul 03 14:03:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] Group snapshot d5abc7d0-67f4-4155-98aa-d7c52da9cdd4: creating. {{(pid=86805) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 14:03:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] Creating offline snapshot a182be51-b2e7-47ce-9fbb-181b97091b42 of volume 3a4d2307-4242-4101-8963-0e1686831709 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:03:43 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d413f9cb-c05f-4771-ba35-7bd49f94ca04]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:43 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709 Jul 03 14:03:43 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:43 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774" returned: 0 in 1.236s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:44 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774 Jul 03 14:03:44 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:44 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709" returned: 0 in 1.290s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:44 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42 1G Jul 03 14:03:44 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:44 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f33a509f-d839-4a1f-acb2-c47ecb4f1774" returned: 0 in 0.895s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:44 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-f33a509f-d839-4a1f-acb2-c47ecb4f1774" released by "delete_volume" :: held 2.243s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:44 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Created reservations ['aa461bef-18b6-4745-a5f9-c305c47cee7e', '818261f0-2835-44e0-9094-35c91fbb9864', '8f9722f4-6ad9-48ea-b939-e7b6d19cd4d0', 'ffdd7690-f6cf-44cb-b148-62c371036d1d'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:45 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:03:45 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:45 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_h3jdkt3vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5" returned: 0 in 2.569s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:45 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_h3jdkt3vdevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:03:45 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Converted 112.00 MB image at 43.56 MB/s Jul 03 14:03:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:45 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 1G Jul 03 14:03:45 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:45 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42 1G" returned: 0 in 0.989s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a4d2307-4242-4101-8963-0e1686831709 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:45 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a4d2307-4242-4101-8963-0e1686831709 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42 Jul 03 14:03:45 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:45 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "cinder-a8c8e872-c030-4f1d-9bac-dff336561927-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:46 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-a8c8e872-c030-4f1d-9bac-dff336561927-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:46 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.995s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:46 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:46 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Deleted volume successfully. Jul 03 14:03:46 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-99f7a69a-97b0-47d2-ae41-4ab76fbe89d1 req-ea879e21-6840-417b-a01e-30980d08cd3f tempest-TestMinimumBasicScenario-1712053428 None] Terminate volume connection completed successfully. Jul 03 14:03:46 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-99f7a69a-97b0-47d2-ae41-4ab76fbe89d1 req-ea879e21-6840-417b-a01e-30980d08cd3f tempest-TestMinimumBasicScenario-1712053428 None] Deleting attachment 29b4cf87-c1ee-48de-a6ba-1b03eff61134. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:03:46 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-010ed671-1234-493f-9426-00f43cd744c7 tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-f33a509f-d839-4a1f-acb2-c47ecb4f1774-delete_volume" released by "delete_volume" :: held 7.119s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:46 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "cinder-quobyte-a8c8e872-c030-4f1d-9bac-dff336561927" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:46 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-a8c8e872-c030-4f1d-9bac-dff336561927" acquired by "delete_volume" :: waited 0.021s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:46 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[42555820-c00d-4689-91ea-e984322d5600]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8c8e872-c030-4f1d-9bac-dff336561927 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:46 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8c8e872-c030-4f1d-9bac-dff336561927 Jul 03 14:03:46 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:46 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 1G" returned: 0 in 1.023s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:46 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5653ec-0d8c-43e4-b699-e154b67f094f]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:46 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a4d2307-4242-4101-8963-0e1686831709 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42" returned: 0 in 0.968s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:46 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 14:03:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:46 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 Jul 03 14:03:46 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:46 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42 Jul 03 14:03:46 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:47 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8c8e872-c030-4f1d-9bac-dff336561927" returned: 0 in 0.873s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8c8e872-c030-4f1d-9bac-dff336561927 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:47 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8c8e872-c030-4f1d-9bac-dff336561927 Jul 03 14:03:47 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:47 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5" returned: 0 in 0.814s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:47 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42" returned: 0 in 0.710s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:47 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.info Jul 03 14:03:47 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:47 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 Jul 03 14:03:47 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:47 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8c8e872-c030-4f1d-9bac-dff336561927" returned: 0 in 0.706s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-quobyte-a8c8e872-c030-4f1d-9bac-dff336561927" released by "delete_volume" :: held 1.621s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:47 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] Created reservations ['d2079e2b-7cad-47b3-a424-ab0c6d5ba13d', '719c75dc-d7b8-4942-9255-042c91e9fbf1', '152c10c8-45a7-49cc-bbd8-8e4d6213ee38', '1674cb9b-6267-4377-9c7a-6e198b50f5c2'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:47 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:03:47 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:48 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.info" returned: 0 in 0.798s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:48 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] Acquiring lock "cinder-24cc1dbc-6b5a-413d-956d-22ee3ed682c4-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:48 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.info Jul 03 14:03:48 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] Lock "cinder-24cc1dbc-6b5a-413d-956d-22ee3ed682c4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] Acquiring lock "cinder-quobyte-24cc1dbc-6b5a-413d-956d-22ee3ed682c4" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] Lock "cinder-quobyte-24cc1dbc-6b5a-413d-956d-22ee3ed682c4" acquired by "delete_volume" :: waited 0.027s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3876175e-4cd2-4cd0-9dc2-2d88dd563481]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:48 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5" returned: 1 in 1.044s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Downloaded image 14be8f8b-de0c-4029-a83f-c66e4cebc518 ((None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}])) to volume 8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 successfully. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Temporary image 14be8f8b-de0c-4029-a83f-c66e4cebc518 for user 737deacf114a46eca61a5726eb7fcc59 is deleted. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Marking volume 8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 as bootable. {{(pid=86805) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Copying metadata from image 14be8f8b-de0c-4029-a83f-c66e4cebc518 to 8bb7baa0-8e09-495b-9ebf-5997fa8ceef5. {{(pid=86805) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Creating volume glance metadata for volume 8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 backed by image 14be8f8b-de0c-4029-a83f-c66e4cebc518 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86805) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 14:03:48 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4 Jul 03 14:03:48 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f005e4-371b-465c-a870-1ba04b66a6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5', 'volume_size': 1, 'image_id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '50c6afe76f7e4b1c8c512d52058b3c26', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'created_at': datetime.datetime(2026, 7, 3, 11, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14be8f8b-de0c-4029-a83f-c66e4cebc518/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da791d1-ab4d-44ea-a782-56d39ca24b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:48 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Volume volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 (8bb7baa0-8e09-495b-9ebf-5997fa8ceef5): created successfully Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da791d1-ab4d-44ea-a782-56d39ca24b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Flow 'volume_create_manager' (23912372-1a49-4174-83c9-74e493024adf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:48 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-656759c7-8738-44aa-94b5-63c5a6be44a2 tempest-VolumesExtendTest-1658341632 None] Created volume successfully. Jul 03 14:03:48 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.754s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:48 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] Deleted volume successfully. Jul 03 14:03:48 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-17029ca6-daec-49e1-b3e0-28199c3f52ef tempest-VolumesDeleteCascade-674605090 None] Lock "cinder-a8c8e872-c030-4f1d-9bac-dff336561927-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:49 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.info" returned: 0 in 0.990s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.869s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:49 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-fdc3744e-565e-4e15-8643-632dd98f0f80 tempest-GroupSnapshotsV319Test-2110497302 None] group_snapshot d5abc7d0-67f4-4155-98aa-d7c52da9cdd4: created successfully Jul 03 14:03:49 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4" returned: 0 in 1.040s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:49 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4 Jul 03 14:03:49 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4dc92f9c-1e00-49bd-ab02-2a0a99e30cad tempest-VolumesExtendTest-1658341632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4dc92f9c-1e00-49bd-ab02-2a0a99e30cad tempest-VolumesExtendTest-1658341632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:49 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da139b9-6d65-458f-a6f3-812a700a3cd0]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4dc92f9c-1e00-49bd-ab02-2a0a99e30cad tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:49 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 Jul 03 14:03:49 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:50 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] group_snapshot d5abc7d0-67f4-4155-98aa-d7c52da9cdd4: deleting Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] group_snapshot d5abc7d0-67f4-4155-98aa-d7c52da9cdd4: deleting {{(pid=86805) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] Acquiring lock "cinder-quobyte-3a4d2307-4242-4101-8963-0e1686831709" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] Lock "cinder-quobyte-3a4d2307-4242-4101-8963-0e1686831709" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] Acquiring lock "cinder-quobyte-a182be51-b2e7-47ce-9fbb-181b97091b42" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] Lock "cinder-quobyte-a182be51-b2e7-47ce-9fbb-181b97091b42" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] Deleting offline snapshot a182be51-b2e7-47ce-9fbb-181b97091b42 of volume 3a4d2307-4242-4101-8963-0e1686831709 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] snapshot_file for this snap is: volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce347793-6c1e-4adb-9acc-5f30cff8648a]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:50 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-24cc1dbc-6b5a-413d-956d-22ee3ed682c4" returned: 0 in 1.062s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] Lock "cinder-quobyte-24cc1dbc-6b5a-413d-956d-22ee3ed682c4" released by "delete_volume" :: held 2.167s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] Created reservations ['de880c62-f9b0-442a-b4d6-482f7d0709aa', 'a3239514-8ea3-4265-9af6-85b280235b90', 'a7a9f221-8bbb-42c0-be0d-23e6dee77bb3', '9ee53d2d-3aa4-4941-bfcd-5cb82499b96c'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:50 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42 Jul 03 14:03:50 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:50 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4dc92f9c-1e00-49bd-ab02-2a0a99e30cad tempest-VolumesExtendTest-1658341632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5" returned: 0 in 1.130s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4dc92f9c-1e00-49bd-ab02-2a0a99e30cad tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:50 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:03:50 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:50 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 Jul 03 14:03:50 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:51 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42" returned: 0 in 0.970s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:51 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a4d2307-4242-4101-8963-0e1686831709(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:03:51 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a1c411-9a84-4eab-91ed-ad0dac072e9e]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:51 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.804s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:51 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:51 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709 Jul 03 14:03:51 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:51 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] Deleted volume successfully. Jul 03 14:03:51 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=128,cinder:UPDATE=148,cinder:INSERT=47,cinder:DELETE=14 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:03:51 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c7722ae7-2a7d-48a3-a534-c41ba33cccb6 tempest-TestMinimumBasicScenario-1712053428 None] Lock "cinder-24cc1dbc-6b5a-413d-956d-22ee3ed682c4-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:51 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4dc92f9c-1e00-49bd-ab02-2a0a99e30cad tempest-VolumesExtendTest-1658341632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5" returned: 1 in 0.933s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4dc92f9c-1e00-49bd-ab02-2a0a99e30cad tempest-VolumesExtendTest-1658341632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:03:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4dc92f9c-1e00-49bd-ab02-2a0a99e30cad tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 2G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4dc92f9c-1e00-49bd-ab02-2a0a99e30cad tempest-VolumesExtendTest-1658341632 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 2G" returned: 0 in 0.137s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4dc92f9c-1e00-49bd-ab02-2a0a99e30cad tempest-VolumesExtendTest-1658341632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.270s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:51 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=175,cinder:DELETE=12,cinder:SELECT=137,cinder:INSERT=45 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:03:51 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4dc92f9c-1e00-49bd-ab02-2a0a99e30cad tempest-VolumesExtendTest-1658341632 None] Extend volume completed successfully. Jul 03 14:03:52 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709" returned: 0 in 1.098s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:52 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42 Jul 03 14:03:52 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Acquiring lock "cinder-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Lock "cinder-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Acquiring lock "cinder-quobyte-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Lock "cinder-quobyte-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5" acquired by "delete_volume" :: waited 0.032s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:53 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dfd5db-82de-4957-8812-19c1accd6aa0]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:53 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 Jul 03 14:03:53 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:53 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42" returned: 0 in 1.332s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:53 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42 Jul 03 14:03:53 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:54 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5" returned: 0 in 1.069s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:54 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709.a182be51-b2e7-47ce-9fbb-181b97091b42" returned: 0 in 0.903s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:54 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] Lock "cinder-quobyte-a182be51-b2e7-47ce-9fbb-181b97091b42" released by "_delete_snapshot" :: held 4.442s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:54 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] Lock "cinder-quobyte-3a4d2307-4242-4101-8963-0e1686831709" released by "delete_snapshot" :: held 4.496s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:54 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 Jul 03 14:03:54 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:54 devstack cinder-volume[86805]: WARNING cinder.quota [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-498145711 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-498145711, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:03:54 devstack cinder-volume[86805]: WARNING cinder.quota [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-498145711 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-498145711, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:03:54 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] Created reservations ['e2b2c9be-374c-4705-b083-6f668364ca0c', '2cd85eb0-9267-48f6-aff7-238a86c7b5f2', '728ec8c2-8568-4a7d-9da5-e70e27cd8f4a', '980aef95-8929-44cd-9934-5c2e076a14e9'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:54 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-fd82453b-86b3-40ca-a02b-af5a3f27870a tempest-GroupSnapshotsV319Test-2110497302 None] group_snapshot d5abc7d0-67f4-4155-98aa-d7c52da9cdd4: deleted successfully Jul 03 14:03:55 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5" returned: 1 in 0.986s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:03:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:55 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5 Jul 03 14:03:55 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] Acquiring lock "cinder-quobyte-3a4d2307-4242-4101-8963-0e1686831709" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] Lock "cinder-quobyte-3a4d2307-4242-4101-8963-0e1686831709" acquired by "delete_volume" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:56 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a26e90d-ac5b-4926-a7c5-b06a76f86653]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:56 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709 Jul 03 14:03:56 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:56 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5" returned: 0 in 0.925s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Lock "cinder-quobyte-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5" released by "delete_volume" :: held 3.097s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:56 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Created reservations ['fb3bc69b-75dc-48c2-81dc-04c6e16a3c6c', '873cd0d3-7c2b-4392-84a0-d6952795cb0d', 'e9d5c0d7-0d18-4928-872e-9e9a3ab38f0e', 'e3addf36-1f8a-415c-9dbb-ad929d055d15'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:56 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:03:56 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:57 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709" returned: 0 in 1.004s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:57 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709 Jul 03 14:03:57 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:57 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.957s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:57 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:57 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Deleted volume successfully. Jul 03 14:03:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-70764ccd-9d38-41cd-b0f1-8aa116c39049 tempest-VolumesExtendTest-1658341632 None] Lock "cinder-8bb7baa0-8e09-495b-9ebf-5997fa8ceef5-delete_volume" released by "delete_volume" :: held 4.560s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:58 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3a4d2307-4242-4101-8963-0e1686831709" returned: 0 in 0.875s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] Lock "cinder-quobyte-3a4d2307-4242-4101-8963-0e1686831709" released by "delete_volume" :: held 1.962s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] Created reservations ['d6da0882-5d1e-4767-9435-d91e17ac0c1b'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:58 devstack cinder-volume[86805]: WARNING cinder.quota [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-498145711 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-498145711, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] Created reservations ['4c77fc2f-c4b8-4bbf-b13e-b3d2266b5570', 'c745c6f5-aabe-4a86-b348-61129c5e5c8d', 'c188416d-4feb-434e-86f2-1b8ef6b5e0ca', '19c0ceed-6486-4849-b306-b7eee6e89d14'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:58 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:03:58 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:58 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:03:58 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Flow 'volume_create_manager' (2d63b566-60f7-4176-acce-da8a4330b94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab231db-e03f-4134-9ee1-23a95ed4c00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab231db-e03f-4134-9ee1-23a95ed4c00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2080682603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff7b150-dbab-44e4-b7f6-be38728edbb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b71b097d7c845a28a41aa3b68f68db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:59Z,use_quota=True,user_id='737deacf114a46eca61a5726eb7fcc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb5fb78-8464-4417-a14d-08a0b9adf70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb5fb78-8464-4417-a14d-08a0b9adf70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6435a7ea-a479-43b1-811d-eaa693aa7af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6435a7ea-a479-43b1-811d-eaa693aa7af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff7b150-dbab-44e4-b7f6-be38728edbb5', 'volume_name': 'volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2339d86e-f92d-4f72-9a2c-ba5e605100af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2339d86e-f92d-4f72-9a2c-ba5e605100af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5b9caf-4b3d-42f8-91f9-d2ab7a7d1aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:58 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Volume 7ff7b150-dbab-44e4-b7f6-be38728edbb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5', 'volume_size': 1} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2080682603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff7b150-dbab-44e4-b7f6-be38728edbb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b71b097d7c845a28a41aa3b68f68db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:59Z,use_quota=True,user_id='737deacf114a46eca61a5726eb7fcc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Creating volume 7ff7b150-dbab-44e4-b7f6-be38728edbb5 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:03:58 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:03:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:58 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 1073741824 Jul 03 14:03:58 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:59 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.325s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:59 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4ea285b6-ecd2-4349-87f3-568e85af4c4b tempest-GroupSnapshotsV319Test-2110497302 None] Delete group completed successfully. Jul 03 14:04:00 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.623s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:00 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:04:00 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 1073741824" returned: 0 in 1.281s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:00 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 Jul 03 14:04:00 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:01 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5" returned: 0 in 0.874s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:01 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:04:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.237s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5b9caf-4b3d-42f8-91f9-d2ab7a7d1aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01898555-8d1f-42d3-9f36-ac1096454738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:01 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Volume volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 (7ff7b150-dbab-44e4-b7f6-be38728edbb5): created successfully Jul 03 14:04:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01898555-8d1f-42d3-9f36-ac1096454738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Flow 'volume_create_manager' (2d63b566-60f7-4176-acce-da8a4330b94f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:01 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-337e3c04-f9a5-467c-8381-3e3fd0e0f484 tempest-VolumesExtendTest-1658341632 None] Created volume successfully. Jul 03 14:04:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] Creating offline snapshot 32d593fa-0b71-4730-b18b-3737d6e8ddf3 of volume 7ff7b150-dbab-44e4-b7f6-be38728edbb5 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:04:02 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cef6641-f411-4366-8310-c0e004969aa7]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:02 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 Jul 03 14:04:02 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:03 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5" returned: 0 in 0.929s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:03 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3 1G Jul 03 14:04:03 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:04 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3 1G" returned: 0 in 1.070s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:04 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3 Jul 03 14:04:04 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:05 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3" returned: 0 in 1.265s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:05 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3 is being set with open permissions: ugo+rw Jul 03 14:04:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:05 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3 Jul 03 14:04:05 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:05 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:04:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Flow 'volume_create_manager' (f80d2f25-1db8-4e9f-9d4b-9957926ceb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f0ef89-6cd8-475c-9fef-fd457ba4d4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f0ef89-6cd8-475c-9fef-fd457ba4d4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1713371879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd22e58-fca2-4cb8-b071-ee1b6d576efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd4626c8c87e4b62a4d928db795df3f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:06Z,use_quota=True,user_id='31da726c14074c82a5580611a2018ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb77b47a-d5cd-40b0-a10e-e07e4198aa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb77b47a-d5cd-40b0-a10e-e07e4198aa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f19812-eb13-4336-9ae0-2721060d658b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f19812-eb13-4336-9ae0-2721060d658b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfd22e58-fca2-4cb8-b071-ee1b6d576efd', 'volume_name': 'volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3146cfe1-a21d-4b22-81f5-2d10eb259c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3146cfe1-a21d-4b22-81f5-2d10eb259c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98bfb50a-44d8-44c9-a853-e5c616f8c940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:06 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Volume cfd22e58-fca2-4cb8-b071-ee1b6d576efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd', 'volume_size': 1} Jul 03 14:04:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:06 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3" returned: 0 in 0.923s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:06 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.info Jul 03 14:04:06 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:07 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.info" returned: 0 in 0.789s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:07 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.info is being set with open permissions: ugo+rw Jul 03 14:04:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:07 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.info Jul 03 14:04:07 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:07 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.info" returned: 0 in 0.699s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.801s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.773s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1713371879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd22e58-fca2-4cb8-b071-ee1b6d576efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd4626c8c87e4b62a4d928db795df3f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:06Z,use_quota=True,user_id='31da726c14074c82a5580611a2018ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:04:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Creating volume cfd22e58-fca2-4cb8-b071-ee1b6d576efd {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:04:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:04:07 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:04:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:07 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd 1073741824 Jul 03 14:04:07 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:07 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-c75f335f-2d6d-4c58-b559-dc275b35c56a tempest-VolumesExtendTest-1658341632 None] Create snapshot completed successfully Jul 03 14:04:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-737ea1af-ab37-43db-934a-a7429199b48b tempest-VolumesExtendTest-1658341632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:08 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd 1073741824" returned: 0 in 0.987s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:08 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd Jul 03 14:04:08 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:09 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" returned: 0 in 0.673s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-737ea1af-ab37-43db-934a-a7429199b48b tempest-VolumesExtendTest-1658341632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.032s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98bfb50a-44d8-44c9-a853-e5c616f8c940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7d9cf7-bd27-40a0-9645-f059ab23ad24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f26f8f-7abb-4b60-a71b-23e95391bb5e]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-737ea1af-ab37-43db-934a-a7429199b48b tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:09 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Volume volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd (cfd22e58-fca2-4cb8-b071-ee1b6d576efd): created successfully Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7d9cf7-bd27-40a0-9645-f059ab23ad24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Flow 'volume_create_manager' (f80d2f25-1db8-4e9f-9d4b-9957926ceb8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:09 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-17957203-6b3a-4b4e-81e5-c7ee01867261 tempest-VolumesActionsTest-1536353181 None] Created volume successfully. Jul 03 14:04:09 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 Jul 03 14:04:09 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Flow 'volume_create_manager' (d2bf2279-2a8d-42a5-b37b-7e3a5495d318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b91d160-5ade-467b-88a6-55c3aa956f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b91d160-5ade-467b-88a6-55c3aa956f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-608827103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b9d5f0-2ffd-49c2-9880-ed0d67ded53e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5bcae78db4fc198574c0c480f5cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:10Z,use_quota=True,user_id='19023cda3ee94a6ba8c61daf6286a07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d44f3b-a166-405b-9a51-d3b8c06fdd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d44f3b-a166-405b-9a51-d3b8c06fdd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c09726-aba4-491e-a484-1d7b65bfd38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c09726-aba4-491e-a484-1d7b65bfd38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71b9d5f0-2ffd-49c2-9880-ed0d67ded53e', 'volume_name': 'volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beef685f-d410-4dbd-8610-cb62f69f477f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beef685f-d410-4dbd-8610-cb62f69f477f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6a1482-5f45-4760-92b6-d2e5e06b7411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:09 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Volume 71b9d5f0-2ffd-49c2-9880-ed0d67ded53e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e', 'volume_size': 1} Jul 03 14:04:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-737ea1af-ab37-43db-934a-a7429199b48b tempest-VolumesExtendTest-1658341632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5" returned: 0 in 0.948s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:10 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-737ea1af-ab37-43db-934a-a7429199b48b tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3 2G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-737ea1af-ab37-43db-934a-a7429199b48b tempest-VolumesExtendTest-1658341632 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3 2G" returned: 0 in 0.176s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-737ea1af-ab37-43db-934a-a7429199b48b tempest-VolumesExtendTest-1658341632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.182s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.850s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-608827103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b9d5f0-2ffd-49c2-9880-ed0d67ded53e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5bcae78db4fc198574c0c480f5cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:10Z,use_quota=True,user_id='19023cda3ee94a6ba8c61daf6286a07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:04:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Creating volume 71b9d5f0-2ffd-49c2-9880-ed0d67ded53e {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:04:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:04:10 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:04:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:10 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e 1073741824 Jul 03 14:04:10 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:10 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-737ea1af-ab37-43db-934a-a7429199b48b tempest-VolumesExtendTest-1658341632 None] Extend volume completed successfully. Jul 03 14:04:11 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e 1073741824" returned: 0 in 1.153s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:12 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e Jul 03 14:04:12 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] Acquiring lock "cinder-32d593fa-0b71-4730-b18b-3737d6e8ddf3-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] Lock "cinder-32d593fa-0b71-4730-b18b-3737d6e8ddf3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] Acquiring lock "cinder-quobyte-7ff7b150-dbab-44e4-b7f6-be38728edbb5" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] Lock "cinder-quobyte-7ff7b150-dbab-44e4-b7f6-be38728edbb5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] Acquiring lock "cinder-quobyte-32d593fa-0b71-4730-b18b-3737d6e8ddf3" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] Lock "cinder-quobyte-32d593fa-0b71-4730-b18b-3737d6e8ddf3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] Deleting offline snapshot 32d593fa-0b71-4730-b18b-3737d6e8ddf3 of volume 7ff7b150-dbab-44e4-b7f6-be38728edbb5 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] snapshot_file for this snap is: volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d459d06-bba9-4fb2-8f1c-89207127719a]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:12 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3 Jul 03 14:04:12 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:12 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" returned: 0 in 0.822s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6a1482-5f45-4760-92b6-d2e5e06b7411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac06c39-8f03-40f3-9d1d-1af27a69df7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:12 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Volume volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e (71b9d5f0-2ffd-49c2-9880-ed0d67ded53e): created successfully Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac06c39-8f03-40f3-9d1d-1af27a69df7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Flow 'volume_create_manager' (d2bf2279-2a8d-42a5-b37b-7e3a5495d318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:12 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-64f0c4e1-0738-4861-af9e-3fe1a4979818 tempest-SnapshotsActionsTest-184183765 None] Created volume successfully. Jul 03 14:04:13 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3" returned: 0 in 0.953s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:04:13 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[489d503b-aca9-413a-ae70-33601f76d796]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:13 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 Jul 03 14:04:13 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:14 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5" returned: 0 in 0.861s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:14 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3 Jul 03 14:04:14 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] Creating offline snapshot 11ff8b7e-a4eb-4ab2-a1fb-e29581452695 of volume 71b9d5f0-2ffd-49c2-9880-ed0d67ded53e {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:04:14 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6b47f7-efc6-498c-a7ca-9caad3a8559f]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:14 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e Jul 03 14:04:14 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:15 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3" returned: 0 in 1.029s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:15 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3 Jul 03 14:04:15 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:15 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" returned: 0 in 0.866s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:15 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 1G Jul 03 14:04:15 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Flow 'volume_create_manager' (c84f2254-19ef-4a1c-a4ca-84d8a05ac0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd87ba8-9240-439d-b587-2744951cff2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd87ba8-9240-439d-b587-2744951cff2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1565770619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2ade17-9b55-4cc7-ac12-b11113f2adee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8841916dade4e08841f6c0cc4264108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:15Z,use_quota=True,user_id='fe71dcd8ca204b8d91bafaa5376f502a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b3b960-67de-4ad6-930e-aab8ef2f435a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b3b960-67de-4ad6-930e-aab8ef2f435a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eafc10c-4b1d-46a0-a1a0-8c187f181c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eafc10c-4b1d-46a0-a1a0-8c187f181c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e2ade17-9b55-4cc7-ac12-b11113f2adee', 'volume_name': 'volume-0e2ade17-9b55-4cc7-ac12-b11113f2adee', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42328c7-1f98-479d-b12f-f02c1e915975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42328c7-1f98-479d-b12f-f02c1e915975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84817e1c-82c3-4cbf-a94a-da1f3b9ad37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:15 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Volume 0e2ade17-9b55-4cc7-ac12-b11113f2adee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e2ade17-9b55-4cc7-ac12-b11113f2adee', 'volume_size': 1} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Flow 'volume_create_manager' (03f76320-231c-44ae-8552-e7357a52fa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401ccc5f-8e67-410e-9292-47cc8be9feb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401ccc5f-8e67-410e-9292-47cc8be9feb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-569049319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec0485b-0237-46af-9918-fba9000a1386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8841916dade4e08841f6c0cc4264108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:16Z,use_quota=True,user_id='fe71dcd8ca204b8d91bafaa5376f502a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1b7e0a-2c0d-419d-98a1-9b9f3f91884b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1b7e0a-2c0d-419d-98a1-9b9f3f91884b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded19ebc-03c1-4111-9e2e-abd882ed23ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded19ebc-03c1-4111-9e2e-abd882ed23ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ec0485b-0237-46af-9918-fba9000a1386', 'volume_name': 'volume-6ec0485b-0237-46af-9918-fba9000a1386', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22848a0f-7639-43b5-8ba5-56c3d4e3f338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22848a0f-7639-43b5-8ba5-56c3d4e3f338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c486922-6ea0-42ae-8fd7-024e7e535c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:15 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Volume 6ec0485b-0237-46af-9918-fba9000a1386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ec0485b-0237-46af-9918-fba9000a1386', 'volume_size': 1} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:15 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5.32d593fa-0b71-4730-b18b-3737d6e8ddf3" returned: 0 in 0.787s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] Lock "cinder-quobyte-32d593fa-0b71-4730-b18b-3737d6e8ddf3" released by "_delete_snapshot" :: held 3.757s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] Lock "cinder-quobyte-7ff7b150-dbab-44e4-b7f6-be38728edbb5" released by "delete_snapshot" :: held 3.785s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:15 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] Created reservations ['f726ef11-d2d5-435b-b582-dd505579c20e', 'b0046b73-e269-413f-aebb-86e043d49300', '200b0251-53ea-4e0d-9505-92db6f0bc30c', '4467a510-95ce-47d7-a7c0-6007afc8f232'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:04:16 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] Delete snapshot completed successfully. Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d24e19c-e0a6-4d48-b219-4edab08b0b24 tempest-VolumesExtendTest-1658341632 None] Lock "cinder-32d593fa-0b71-4730-b18b-3737d6e8ddf3-delete_snapshot" released by "delete_snapshot" :: held 3.955s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Flow 'volume_create_manager' (8fea6482-908e-4834-8c0f-3d65e1eed26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbb4303-1b94-4f71-bc79-49192c9897c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbb4303-1b94-4f71-bc79-49192c9897c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-767713609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03bc72ba-8d03-4344-bd8d-1479434f4189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8841916dade4e08841f6c0cc4264108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:16Z,use_quota=True,user_id='fe71dcd8ca204b8d91bafaa5376f502a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a37a26d-598d-4be6-b421-1bb25dfaf2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a37a26d-598d-4be6-b421-1bb25dfaf2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57fe4bfc-5502-4fb3-98ca-bd4ad2b4b937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57fe4bfc-5502-4fb3-98ca-bd4ad2b4b937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03bc72ba-8d03-4344-bd8d-1479434f4189', 'volume_name': 'volume-03bc72ba-8d03-4344-bd8d-1479434f4189', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097c4871-9bc1-4359-99d4-a40eeef5fef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097c4871-9bc1-4359-99d4-a40eeef5fef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974a1fa0-e4b2-4d2d-8a97-e23a86f080f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:16 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Volume 03bc72ba-8d03-4344-bd8d-1479434f4189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03bc72ba-8d03-4344-bd8d-1479434f4189', 'volume_size': 1} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:16 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 1G" returned: 0 in 1.075s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:16 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 Jul 03 14:04:16 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] Acquiring lock "cinder-7ff7b150-dbab-44e4-b7f6-be38728edbb5-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] Lock "cinder-7ff7b150-dbab-44e4-b7f6-be38728edbb5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Flow 'volume_create_manager' (d6394260-07f5-499a-885a-2f1b7e87d168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1aafe10-348b-445b-a138-dfe3ed9daab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1aafe10-348b-445b-a138-dfe3ed9daab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-79557020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad548ee-4229-4572-891c-4ab7631d5b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8841916dade4e08841f6c0cc4264108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:16Z,use_quota=True,user_id='fe71dcd8ca204b8d91bafaa5376f502a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09fee865-e408-4b64-bc3d-d0fcbac622c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09fee865-e408-4b64-bc3d-d0fcbac622c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8dd8003-69f8-4c73-9627-581f85e388ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8dd8003-69f8-4c73-9627-581f85e388ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ad548ee-4229-4572-891c-4ab7631d5b4a', 'volume_name': 'volume-9ad548ee-4229-4572-891c-4ab7631d5b4a', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b0e128-40ee-4572-80c4-89bdeb4578f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b0e128-40ee-4572-80c4-89bdeb4578f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b447f74-90d6-4e26-9a99-2b3881b7af07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:16 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Volume 9ad548ee-4229-4572-891c-4ab7631d5b4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ad548ee-4229-4572-891c-4ab7631d5b4a', 'volume_size': 1} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] Acquiring lock "cinder-quobyte-7ff7b150-dbab-44e4-b7f6-be38728edbb5" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] Lock "cinder-quobyte-7ff7b150-dbab-44e4-b7f6-be38728edbb5" acquired by "delete_volume" :: waited 0.027s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[53949d5d-1981-4061-b2b6-b761810ab841]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:16 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 Jul 03 14:04:16 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:17 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:04:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Flow 'volume_create_manager' (0aea47eb-4108-46a4-a4ff-846bd59434e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083d4d37-a457-44b0-860a-8c57cda49932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083d4d37-a457-44b0-860a-8c57cda49932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1859058036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9dbe2f8-df8e-4857-bbe5-8d617af85288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8841916dade4e08841f6c0cc4264108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:17Z,use_quota=True,user_id='fe71dcd8ca204b8d91bafaa5376f502a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a616e0-f9c4-4b1f-af3e-2e29c0423069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a616e0-f9c4-4b1f-af3e-2e29c0423069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98522963-46d3-4da6-a5b1-5421973ca8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98522963-46d3-4da6-a5b1-5421973ca8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9dbe2f8-df8e-4857-bbe5-8d617af85288', 'volume_name': 'volume-f9dbe2f8-df8e-4857-bbe5-8d617af85288', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76dbad7-0603-431f-afcc-d1657b0a8b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76dbad7-0603-431f-afcc-d1657b0a8b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451e6f44-31b4-4caf-adab-45fa048acff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:17 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Volume f9dbe2f8-df8e-4857-bbe5-8d617af85288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9dbe2f8-df8e-4857-bbe5-8d617af85288', 'volume_size': 1} Jul 03 14:04:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:17 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695" returned: 0 in 0.961s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:17 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 is being set with open permissions: ugo+rw Jul 03 14:04:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:17 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 Jul 03 14:04:17 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:17 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5" returned: 0 in 1.072s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:17 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5 Jul 03 14:04:17 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:18 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695" returned: 0 in 1.013s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:18 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.info Jul 03 14:04:18 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:18 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ff7b150-dbab-44e4-b7f6-be38728edbb5" returned: 0 in 0.765s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] Lock "cinder-quobyte-7ff7b150-dbab-44e4-b7f6-be38728edbb5" released by "delete_volume" :: held 1.931s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:18 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] Created reservations ['fd26a818-2610-41dc-95a0-6c66fb134b9c', '7d2638ff-86d1-4cd4-b8a4-db2df97d624d', 'd74549f8-8f6f-4108-90ba-99800ccb46df', '28b1051e-804c-435c-9f68-5cdaaee25a3e'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:04:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:18 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:04:18 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:19 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.info" returned: 0 in 0.858s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:19 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.info is being set with open permissions: ugo+rw Jul 03 14:04:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:19 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.info Jul 03 14:04:19 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:19 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.779s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:19 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:04:19 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] Deleted volume successfully. Jul 03 14:04:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-deb47d5c-488c-4d04-89ee-73c23b535d5d tempest-VolumesExtendTest-1658341632 None] Lock "cinder-7ff7b150-dbab-44e4-b7f6-be38728edbb5-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:19 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.info" returned: 0 in 0.704s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.591s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.444s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1565770619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2ade17-9b55-4cc7-ac12-b11113f2adee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8841916dade4e08841f6c0cc4264108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:15Z,use_quota=True,user_id='fe71dcd8ca204b8d91bafaa5376f502a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:04:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Creating volume 0e2ade17-9b55-4cc7-ac12-b11113f2adee {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:04:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:04:19 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:04:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e2ade17-9b55-4cc7-ac12-b11113f2adee 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:19 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e2ade17-9b55-4cc7-ac12-b11113f2adee 1073741824 Jul 03 14:04:19 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:19 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-dc36924e-a8ad-48e6-a90a-ffe983aee314 tempest-SnapshotsActionsTest-184183765 None] Create snapshot completed successfully Jul 03 14:04:20 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e2ade17-9b55-4cc7-ac12-b11113f2adee 1073741824" returned: 0 in 0.994s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e2ade17-9b55-4cc7-ac12-b11113f2adee {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:20 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e2ade17-9b55-4cc7-ac12-b11113f2adee Jul 03 14:04:20 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f0c4aa07-21f4-4a71-ab3a-9069ad74dc53 tempest-SnapshotsActionsTest-184183765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:21 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e2ade17-9b55-4cc7-ac12-b11113f2adee" returned: 0 in 0.863s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.017s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-569049319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec0485b-0237-46af-9918-fba9000a1386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8841916dade4e08841f6c0cc4264108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:16Z,use_quota=True,user_id='fe71dcd8ca204b8d91bafaa5376f502a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Creating volume 6ec0485b-0237-46af-9918-fba9000a1386 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:04:21 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6ec0485b-0237-46af-9918-fba9000a1386 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:21 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6ec0485b-0237-46af-9918-fba9000a1386 1073741824 Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84817e1c-82c3-4cbf-a94a-da1f3b9ad37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e2ade17-9b55-4cc7-ac12-b11113f2adee', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:21 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985e9b34-b400-4937-8f04-11adddd1351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:21 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Volume volume-0e2ade17-9b55-4cc7-ac12-b11113f2adee (0e2ade17-9b55-4cc7-ac12-b11113f2adee): created successfully Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985e9b34-b400-4937-8f04-11adddd1351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Flow 'volume_create_manager' (c84f2254-19ef-4a1c-a4ca-84d8a05ac0b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:21 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-6243fda2-9ec9-4fce-98e9-edc56c228e33 tempest-CreateVolumesFromImageTest-11977883 None] Created volume successfully. Jul 03 14:04:22 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6ec0485b-0237-46af-9918-fba9000a1386 1073741824" returned: 0 in 0.946s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6ec0485b-0237-46af-9918-fba9000a1386 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:22 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6ec0485b-0237-46af-9918-fba9000a1386 Jul 03 14:04:22 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:23 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6ec0485b-0237-46af-9918-fba9000a1386" returned: 0 in 0.700s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:04:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.292s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-767713609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03bc72ba-8d03-4344-bd8d-1479434f4189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8841916dade4e08841f6c0cc4264108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:16Z,use_quota=True,user_id='fe71dcd8ca204b8d91bafaa5376f502a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:04:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Creating volume 03bc72ba-8d03-4344-bd8d-1479434f4189 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:04:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:04:23 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:04:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-03bc72ba-8d03-4344-bd8d-1479434f4189 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:23 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-03bc72ba-8d03-4344-bd8d-1479434f4189 1073741824 Jul 03 14:04:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c486922-6ea0-42ae-8fd7-024e7e535c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ec0485b-0237-46af-9918-fba9000a1386', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:23 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66ad948-52eb-494d-a1ef-6a4a47f7b052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:23 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Volume volume-6ec0485b-0237-46af-9918-fba9000a1386 (6ec0485b-0237-46af-9918-fba9000a1386): created successfully Jul 03 14:04:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66ad948-52eb-494d-a1ef-6a4a47f7b052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Flow 'volume_create_manager' (03f76320-231c-44ae-8552-e7357a52fa20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:23 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-0e92a40a-751f-4e18-8e51-db52b3db75ef tempest-CreateVolumesFromImageTest-11977883 None] Created volume successfully. Jul 03 14:04:24 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-03bc72ba-8d03-4344-bd8d-1479434f4189 1073741824" returned: 0 in 1.072s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-03bc72ba-8d03-4344-bd8d-1479434f4189 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:24 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-03bc72ba-8d03-4344-bd8d-1479434f4189 Jul 03 14:04:24 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:25 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-03bc72ba-8d03-4344-bd8d-1479434f4189" returned: 0 in 1.172s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] <== create_volume: return (2356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:04:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.362s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.150s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-79557020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad548ee-4229-4572-891c-4ab7631d5b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8841916dade4e08841f6c0cc4264108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:16Z,use_quota=True,user_id='fe71dcd8ca204b8d91bafaa5376f502a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:04:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Creating volume 9ad548ee-4229-4572-891c-4ab7631d5b4a {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:04:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:04:25 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:04:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ad548ee-4229-4572-891c-4ab7631d5b4a 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974a1fa0-e4b2-4d2d-8a97-e23a86f080f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03bc72ba-8d03-4344-bd8d-1479434f4189', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7550d86f-dcd8-4436-a485-9d5f03df89cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:25 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ad548ee-4229-4572-891c-4ab7631d5b4a 1073741824 Jul 03 14:04:25 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:25 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Volume volume-03bc72ba-8d03-4344-bd8d-1479434f4189 (03bc72ba-8d03-4344-bd8d-1479434f4189): created successfully Jul 03 14:04:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7550d86f-dcd8-4436-a485-9d5f03df89cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Flow 'volume_create_manager' (8fea6482-908e-4834-8c0f-3d65e1eed26c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:25 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-68b662cb-4cb0-48a8-afe1-3e09285b96d2 tempest-CreateVolumesFromImageTest-11977883 None] Created volume successfully. Jul 03 14:04:27 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ad548ee-4229-4572-891c-4ab7631d5b4a 1073741824" returned: 0 in 1.261s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ad548ee-4229-4572-891c-4ab7631d5b4a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:27 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ad548ee-4229-4572-891c-4ab7631d5b4a Jul 03 14:04:27 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:28 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ad548ee-4229-4572-891c-4ab7631d5b4a" returned: 0 in 0.842s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] <== create_volume: return (2159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.162s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.923s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1859058036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9dbe2f8-df8e-4857-bbe5-8d617af85288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8841916dade4e08841f6c0cc4264108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:17Z,use_quota=True,user_id='fe71dcd8ca204b8d91bafaa5376f502a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Creating volume f9dbe2f8-df8e-4857-bbe5-8d617af85288 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:04:28 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9dbe2f8-df8e-4857-bbe5-8d617af85288 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b447f74-90d6-4e26-9a99-2b3881b7af07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad548ee-4229-4572-891c-4ab7631d5b4a', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:28 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9dbe2f8-df8e-4857-bbe5-8d617af85288 1073741824 Jul 03 14:04:28 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aad5e36-bab7-4a9d-9fa4-cbe98e6ccf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:28 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Volume volume-9ad548ee-4229-4572-891c-4ab7631d5b4a (9ad548ee-4229-4572-891c-4ab7631d5b4a): created successfully Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aad5e36-bab7-4a9d-9fa4-cbe98e6ccf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Flow 'volume_create_manager' (d6394260-07f5-499a-885a-2f1b7e87d168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-04bb66de-41b7-487a-ad14-cfa53b5fb506 tempest-CreateVolumesFromImageTest-11977883 None] Created volume successfully. Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-01f99e6e-a241-4e97-968b-fd6c9d756b38 tempest-VolumesActionsTest-1536353181 None] Acquiring lock "cinder-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" by "attach_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-01f99e6e-a241-4e97-968b-fd6c9d756b38 tempest-VolumesActionsTest-1536353181 None] Lock "cinder-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" acquired by "attach_volume" :: waited 0.015s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-01f99e6e-a241-4e97-968b-fd6c9d756b38 tempest-VolumesActionsTest-1536353181 None] Attaching volume cfd22e58-fca2-4cb8-b071-ee1b6d576efd to instance f354ade4-bf22-47c4-9537-70a316934d38 at mountpoint /dev/vdb on host None. Jul 03 14:04:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-01f99e6e-a241-4e97-968b-fd6c9d756b38 tempest-VolumesActionsTest-1536353181 None] Attach volume completed successfully. Jul 03 14:04:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-01f99e6e-a241-4e97-968b-fd6c9d756b38 tempest-VolumesActionsTest-1536353181 None] Lock "cinder-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" released by "attach_volume" :: held 0.104s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:29 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9dbe2f8-df8e-4857-bbe5-8d617af85288 1073741824" returned: 0 in 0.997s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9dbe2f8-df8e-4857-bbe5-8d617af85288 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:29 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9dbe2f8-df8e-4857-bbe5-8d617af85288 Jul 03 14:04:29 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-dcf1a142-adba-4b31-a16b-f2acb83a823d tempest-VolumesActionsTest-1536353181 None] Acquiring lock "cinder-cfd22e58-fca2-4cb8-b071-ee1b6d576efd-detach_volume" by "detach_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-dcf1a142-adba-4b31-a16b-f2acb83a823d tempest-VolumesActionsTest-1536353181 None] Lock "cinder-cfd22e58-fca2-4cb8-b071-ee1b6d576efd-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:29 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-dcf1a142-adba-4b31-a16b-f2acb83a823d tempest-VolumesActionsTest-1536353181 None] Detaching volume cfd22e58-fca2-4cb8-b071-ee1b6d576efd from instance f354ade4-bf22-47c4-9537-70a316934d38. Jul 03 14:04:29 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-dcf1a142-adba-4b31-a16b-f2acb83a823d tempest-VolumesActionsTest-1536353181 None] Detach volume completed successfully. Jul 03 14:04:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-dcf1a142-adba-4b31-a16b-f2acb83a823d tempest-VolumesActionsTest-1536353181 None] Lock "cinder-cfd22e58-fca2-4cb8-b071-ee1b6d576efd-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:29 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9dbe2f8-df8e-4857-bbe5-8d617af85288" returned: 0 in 0.757s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:04:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f0c4aa07-21f4-4a71-ab3a-9069ad74dc53 tempest-SnapshotsActionsTest-184183765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.379s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451e6f44-31b4-4caf-adab-45fa048acff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9dbe2f8-df8e-4857-bbe5-8d617af85288', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a6b41f-6bc4-4d0c-b1ac-0688c9f9b345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-f0c4aa07-21f4-4a71-ab3a-9069ad74dc53 tempest-SnapshotsActionsTest-184183765 None] Creating offline snapshot eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0 of volume 71b9d5f0-2ffd-49c2-9880-ed0d67ded53e {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:04:29 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Volume volume-f9dbe2f8-df8e-4857-bbe5-8d617af85288 (f9dbe2f8-df8e-4857-bbe5-8d617af85288): created successfully Jul 03 14:04:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a6b41f-6bc4-4d0c-b1ac-0688c9f9b345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Flow 'volume_create_manager' (0aea47eb-4108-46a4-a4ff-846bd59434e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:29 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f658c8b9-b57d-4190-8a25-ed3c0c843987]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0c4aa07-21f4-4a71-ab3a-9069ad74dc53 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:30 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-c8be60a6-8cfa-4154-a3ff-1298701c20bc tempest-CreateVolumesFromImageTest-11977883 None] Created volume successfully. Jul 03 14:04:30 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 Jul 03 14:04:30 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "cinder-f9dbe2f8-df8e-4857-bbe5-8d617af85288-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-f9dbe2f8-df8e-4857-bbe5-8d617af85288-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "cinder-quobyte-f9dbe2f8-df8e-4857-bbe5-8d617af85288" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-quobyte-f9dbe2f8-df8e-4857-bbe5-8d617af85288" acquired by "delete_volume" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:30 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0224ef-a7eb-41a7-a0be-62bf9293cfc8]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9dbe2f8-df8e-4857-bbe5-8d617af85288 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:31 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9dbe2f8-df8e-4857-bbe5-8d617af85288 Jul 03 14:04:31 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:31 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0c4aa07-21f4-4a71-ab3a-9069ad74dc53 tempest-SnapshotsActionsTest-184183765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695" returned: 0 in 1.149s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-f0c4aa07-21f4-4a71-ab3a-9069ad74dc53 tempest-SnapshotsActionsTest-184183765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:04:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0c4aa07-21f4-4a71-ab3a-9069ad74dc53 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:31 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0 1G Jul 03 14:04:31 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:32 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9dbe2f8-df8e-4857-bbe5-8d617af85288" returned: 0 in 1.514s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9dbe2f8-df8e-4857-bbe5-8d617af85288 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:32 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9dbe2f8-df8e-4857-bbe5-8d617af85288 Jul 03 14:04:32 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:32 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0c4aa07-21f4-4a71-ab3a-9069ad74dc53 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0 1G" returned: 0 in 1.762s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0c4aa07-21f4-4a71-ab3a-9069ad74dc53 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:32 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0 Jul 03 14:04:32 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:33 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9dbe2f8-df8e-4857-bbe5-8d617af85288" returned: 0 in 1.311s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-quobyte-f9dbe2f8-df8e-4857-bbe5-8d617af85288" released by "delete_volume" :: held 2.932s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:33 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0c4aa07-21f4-4a71-ab3a-9069ad74dc53 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0" returned: 0 in 0.906s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:33 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-f0c4aa07-21f4-4a71-ab3a-9069ad74dc53 tempest-SnapshotsActionsTest-184183765 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0 is being set with open permissions: ugo+rw Jul 03 14:04:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0c4aa07-21f4-4a71-ab3a-9069ad74dc53 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:33 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] Created reservations ['2a856915-4a06-434a-84cc-21400f4cbf43', '3ab54eb1-0b7e-47e9-8a5f-00493de9a443', '4392bcca-ea07-4877-8972-35c3bdce3be6', 'c4148230-1bde-4c52-9242-4aedf07d7c9b'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:04:33 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0 Jul 03 14:04:33 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:33 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:04:33 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "cinder-9ad548ee-4229-4572-891c-4ab7631d5b4a-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-9ad548ee-4229-4572-891c-4ab7631d5b4a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "cinder-quobyte-9ad548ee-4229-4572-891c-4ab7631d5b4a" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-quobyte-9ad548ee-4229-4572-891c-4ab7631d5b4a" acquired by "delete_volume" :: waited 0.036s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:34 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d245146d-416d-4faf-bdfa-9614ebc16dc3]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ad548ee-4229-4572-891c-4ab7631d5b4a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:34 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ad548ee-4229-4572-891c-4ab7631d5b4a Jul 03 14:04:34 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:34 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f0c4aa07-21f4-4a71-ab3a-9069ad74dc53 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0" returned: 0 in 1.092s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f0c4aa07-21f4-4a71-ab3a-9069ad74dc53 tempest-SnapshotsActionsTest-184183765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.079s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f0c4aa07-21f4-4a71-ab3a-9069ad74dc53 tempest-SnapshotsActionsTest-184183765 None] Create snapshot completed successfully Jul 03 14:04:35 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.149s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:35 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:04:35 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] Deleted volume successfully. Jul 03 14:04:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-abd809bb-2aa6-4c53-90a4-fb40234d2efc tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-f9dbe2f8-df8e-4857-bbe5-8d617af85288-delete_volume" released by "delete_volume" :: held 4.450s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Acquiring lock "cinder-eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Acquiring lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Acquiring lock "cinder-quobyte-eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-quobyte-eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:35 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Deleting offline snapshot eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0 of volume 71b9d5f0-2ffd-49c2-9880-ed0d67ded53e {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:04:35 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] snapshot_file for this snap is: volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:04:35 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4155525b-2edf-4ea1-a3eb-1d2ff3d8ea32]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:35 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ad548ee-4229-4572-891c-4ab7631d5b4a" returned: 0 in 1.072s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ad548ee-4229-4572-891c-4ab7631d5b4a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:35 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ad548ee-4229-4572-891c-4ab7631d5b4a Jul 03 14:04:35 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:35 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0 Jul 03 14:04:35 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:36 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ad548ee-4229-4572-891c-4ab7631d5b4a" returned: 0 in 0.742s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-quobyte-9ad548ee-4229-4572-891c-4ab7631d5b4a" released by "delete_volume" :: held 1.900s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] Created reservations ['ed0d6f37-cc81-4344-9f58-456d146d971f', '88db85db-9bf3-4819-9742-4dd23c34efbc', '0f78a07f-f55b-4bce-9a2f-a8a0b1885abe', 'e190d0fd-6569-4101-ac3f-3837103a4ba6'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:36 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0" returned: 0 in 1.115s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:04:36 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:04:36 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b72cd00-8040-4fd6-9cc7-377f5e9d5d2d]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "cinder-03bc72ba-8d03-4344-bd8d-1479434f4189-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-03bc72ba-8d03-4344-bd8d-1479434f4189-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "cinder-quobyte-03bc72ba-8d03-4344-bd8d-1479434f4189" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-quobyte-03bc72ba-8d03-4344-bd8d-1479434f4189" acquired by "delete_volume" :: waited 0.021s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4caedd-6fb6-40c6-a226-d765571244aa]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-03bc72ba-8d03-4344-bd8d-1479434f4189 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:36 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 Jul 03 14:04:36 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:37 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-03bc72ba-8d03-4344-bd8d-1479434f4189 Jul 03 14:04:37 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:37 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.021s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:37 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:04:37 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] Deleted volume successfully. Jul 03 14:04:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3afb8014-03d8-4c16-a98a-8a556f43f3f8 tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-9ad548ee-4229-4572-891c-4ab7631d5b4a-delete_volume" released by "delete_volume" :: held 3.345s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:37 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695" returned: 0 in 1.153s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:04:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:37 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0 Jul 03 14:04:37 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:38 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-03bc72ba-8d03-4344-bd8d-1479434f4189" returned: 0 in 1.159s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-03bc72ba-8d03-4344-bd8d-1479434f4189 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:38 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-03bc72ba-8d03-4344-bd8d-1479434f4189 Jul 03 14:04:38 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:39 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-03bc72ba-8d03-4344-bd8d-1479434f4189" returned: 0 in 1.024s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:39 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0" returned: 0 in 1.243s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-quobyte-03bc72ba-8d03-4344-bd8d-1479434f4189" released by "delete_volume" :: held 2.248s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:39 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0 Jul 03 14:04:39 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:39 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] Created reservations ['35fef393-f5be-4011-8e9b-bdc79f27abbe', 'b4e8800e-14ea-4880-939d-d478830f6034', '23ba0b32-7eb5-4d10-ac94-93add5ba68c3', 'b968d9ed-f16a-44e7-9421-18ff0acd8979'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:04:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:39 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:04:39 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:39 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0" returned: 0 in 0.837s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-quobyte-eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0" released by "_delete_snapshot" :: held 4.530s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" released by "delete_snapshot" :: held 4.572s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:40 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.821s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:40 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:04:40 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] Deleted volume successfully. Jul 03 14:04:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a2c8f5fa-408e-47c7-8f61-f09cc726501e tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-03bc72ba-8d03-4344-bd8d-1479434f4189-delete_volume" released by "delete_volume" :: held 3.371s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:40 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Created reservations ['0d5c5946-e3aa-4008-af9f-78b577b4a491', 'a187fcfd-6619-4cb3-a840-2a6dc02c7c58', '79aad3ab-d855-413e-9a77-f42afae05cca', '51d9f46b-2ad8-4f11-acb5-8dfda4007350'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:04:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "cinder-6ec0485b-0237-46af-9918-fba9000a1386-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-6ec0485b-0237-46af-9918-fba9000a1386-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "cinder-quobyte-6ec0485b-0237-46af-9918-fba9000a1386" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:40 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Delete snapshot completed successfully. Jul 03 14:04:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-quobyte-6ec0485b-0237-46af-9918-fba9000a1386" acquired by "delete_volume" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6bc5dbd2-994b-4863-b888-2412bbd7af14 tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-eed00a11-37aa-4e3b-a8d8-c0f2bc45fbc0-delete_snapshot" released by "delete_snapshot" :: held 4.950s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:40 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c7fd63-f087-48a0-898c-f29ba0d5f80b]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6ec0485b-0237-46af-9918-fba9000a1386 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:40 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6ec0485b-0237-46af-9918-fba9000a1386 Jul 03 14:04:40 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:41 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6ec0485b-0237-46af-9918-fba9000a1386" returned: 0 in 0.876s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6ec0485b-0237-46af-9918-fba9000a1386 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:41 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6ec0485b-0237-46af-9918-fba9000a1386 Jul 03 14:04:41 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3583b658-ce06-4aa5-9a99-301b1b60bdc9 tempest-SnapshotsActionsTest-184183765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3583b658-ce06-4aa5-9a99-301b1b60bdc9 tempest-SnapshotsActionsTest-184183765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-3583b658-ce06-4aa5-9a99-301b1b60bdc9 tempest-SnapshotsActionsTest-184183765 None] Creating offline snapshot 657944c2-24ea-4665-84a9-d6cd1b326906 of volume 71b9d5f0-2ffd-49c2-9880-ed0d67ded53e {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:04:41 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2fccf9-c5ec-4476-b818-e0def83ff6ef]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3583b658-ce06-4aa5-9a99-301b1b60bdc9 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:41 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 Jul 03 14:04:41 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:42 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6ec0485b-0237-46af-9918-fba9000a1386" returned: 0 in 0.867s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-quobyte-6ec0485b-0237-46af-9918-fba9000a1386" released by "delete_volume" :: held 1.797s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] Created reservations ['b2aef95e-3b02-4412-b611-c14e9df967e1', '4d6a54b2-d7cc-4ce9-a839-a3fac46f2ee9', 'ba659a83-edad-4321-9b31-fd7ef3454b3c', '090e6500-13f1-4f62-a085-02408c24165b'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:42 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3583b658-ce06-4aa5-9a99-301b1b60bdc9 tempest-SnapshotsActionsTest-184183765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695" returned: 0 in 0.853s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-3583b658-ce06-4aa5-9a99-301b1b60bdc9 tempest-SnapshotsActionsTest-184183765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3583b658-ce06-4aa5-9a99-301b1b60bdc9 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:42 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:04:42 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:42 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906 1G Jul 03 14:04:42 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "cinder-0e2ade17-9b55-4cc7-ac12-b11113f2adee-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-0e2ade17-9b55-4cc7-ac12-b11113f2adee-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "cinder-quobyte-0e2ade17-9b55-4cc7-ac12-b11113f2adee" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-quobyte-0e2ade17-9b55-4cc7-ac12-b11113f2adee" acquired by "delete_volume" :: waited 0.040s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a26683-2b44-4e78-aa88-5ae67583690d]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e2ade17-9b55-4cc7-ac12-b11113f2adee {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:42 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e2ade17-9b55-4cc7-ac12-b11113f2adee Jul 03 14:04:42 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:43 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.969s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:43 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:04:43 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] Deleted volume successfully. Jul 03 14:04:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-60ac1b9f-89ce-42cb-9996-4f6e54451d51 tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-6ec0485b-0237-46af-9918-fba9000a1386-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:43 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3583b658-ce06-4aa5-9a99-301b1b60bdc9 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906 1G" returned: 0 in 1.094s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3583b658-ce06-4aa5-9a99-301b1b60bdc9 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:43 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906 Jul 03 14:04:43 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:43 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e2ade17-9b55-4cc7-ac12-b11113f2adee" returned: 0 in 0.959s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e2ade17-9b55-4cc7-ac12-b11113f2adee {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:43 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e2ade17-9b55-4cc7-ac12-b11113f2adee Jul 03 14:04:43 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:44 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3583b658-ce06-4aa5-9a99-301b1b60bdc9 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906" returned: 0 in 0.812s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:44 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-3583b658-ce06-4aa5-9a99-301b1b60bdc9 tempest-SnapshotsActionsTest-184183765 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906 is being set with open permissions: ugo+rw Jul 03 14:04:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3583b658-ce06-4aa5-9a99-301b1b60bdc9 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:44 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906 Jul 03 14:04:44 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:44 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e2ade17-9b55-4cc7-ac12-b11113f2adee" returned: 0 in 0.862s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:44 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-quobyte-0e2ade17-9b55-4cc7-ac12-b11113f2adee" released by "delete_volume" :: held 1.901s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:44 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] Created reservations ['32ce7344-9707-4ffa-993b-6896333cbd74', 'a6212af3-81c8-48c9-aeed-390d725479be', '12d162ed-9e99-4d36-8886-b2c28ff32e3a', '9e25a175-4433-4551-9dc5-0084cb9665fe'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:04:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:44 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:04:44 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:44 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3583b658-ce06-4aa5-9a99-301b1b60bdc9 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906" returned: 0 in 0.778s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3583b658-ce06-4aa5-9a99-301b1b60bdc9 tempest-SnapshotsActionsTest-184183765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.774s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:45 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-3583b658-ce06-4aa5-9a99-301b1b60bdc9 tempest-SnapshotsActionsTest-184183765 None] Create snapshot completed successfully Jul 03 14:04:45 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Acquiring lock "cinder-657944c2-24ea-4665-84a9-d6cd1b326906-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:45 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-657944c2-24ea-4665-84a9-d6cd1b326906-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:45 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Acquiring lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:45 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:45 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Acquiring lock "cinder-quobyte-657944c2-24ea-4665-84a9-d6cd1b326906" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:45 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-quobyte-657944c2-24ea-4665-84a9-d6cd1b326906" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Deleting offline snapshot 657944c2-24ea-4665-84a9-d6cd1b326906 of volume 71b9d5f0-2ffd-49c2-9880-ed0d67ded53e {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:04:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] snapshot_file for this snap is: volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:04:45 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bd3782-9863-451c-9a44-99212fd178a0]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:46 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906 Jul 03 14:04:46 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:46 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.416s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:46 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:04:46 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] Deleted volume successfully. Jul 03 14:04:46 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0911e746-81f9-4c72-8776-4b84bfbe69a7 tempest-CreateVolumesFromImageTest-11977883 None] Lock "cinder-0e2ade17-9b55-4cc7-ac12-b11113f2adee-delete_volume" released by "delete_volume" :: held 3.740s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:47 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906" returned: 0 in 1.195s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:04:47 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c040417-4b76-4ac3-8319-40fd58fb9998]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:47 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 Jul 03 14:04:47 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:48 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695" returned: 0 in 0.945s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:48 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:04:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:48 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906 Jul 03 14:04:48 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:49 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906" returned: 0 in 0.905s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:49 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906 Jul 03 14:04:49 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:49 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.657944c2-24ea-4665-84a9-d6cd1b326906" returned: 0 in 0.745s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:49 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-quobyte-657944c2-24ea-4665-84a9-d6cd1b326906" released by "_delete_snapshot" :: held 3.992s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:49 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" released by "delete_snapshot" :: held 4.042s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:49 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Created reservations ['c4c8d86f-0f00-487c-b841-fc983701c520', 'cff555ae-935f-4ae6-a469-57b726018936', '78dcd7a3-e44e-4d32-a99f-d2a20b105349', '20281608-6c56-4077-bb8e-a5ebf85cbdfe'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:04:50 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Delete snapshot completed successfully. Jul 03 14:04:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-55d4e222-e619-4097-85b5-09a3bb97882b tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-657944c2-24ea-4665-84a9-d6cd1b326906-delete_snapshot" released by "delete_snapshot" :: held 4.284s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-be60577b-65e8-4cfa-b6d5-be6f83af7766 tempest-SnapshotsActionsTest-184183765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-be60577b-65e8-4cfa-b6d5-be6f83af7766 tempest-SnapshotsActionsTest-184183765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-be60577b-65e8-4cfa-b6d5-be6f83af7766 tempest-SnapshotsActionsTest-184183765 None] Creating offline snapshot 06270726-4d2a-4683-b599-a3b22786bacf of volume 71b9d5f0-2ffd-49c2-9880-ed0d67ded53e {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:04:50 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bc8b55-4965-4d82-a404-3a01734df88f]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-be60577b-65e8-4cfa-b6d5-be6f83af7766 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:50 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 Jul 03 14:04:50 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:51 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-be60577b-65e8-4cfa-b6d5-be6f83af7766 tempest-SnapshotsActionsTest-184183765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695" returned: 0 in 1.160s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:51 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-be60577b-65e8-4cfa-b6d5-be6f83af7766 tempest-SnapshotsActionsTest-184183765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:04:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-be60577b-65e8-4cfa-b6d5-be6f83af7766 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:51 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf 1G Jul 03 14:04:51 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:52 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=98,cinder:UPDATE=130,cinder:INSERT=36,cinder:DELETE=9 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:04:52 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=108,cinder:UPDATE=126,cinder:INSERT=25,cinder:DELETE=10 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:04:52 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:04:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Flow 'volume_create_manager' (a37d271a-1851-455b-8003-4d93c4b1d079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722822fa-d45c-470a-83d2-6c3692e65cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722822fa-d45c-470a-83d2-6c3692e65cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1561120960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45183033-2ba6-4508-b0ca-d0f0e1fb2034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d97cde72b04d549489d5c81edc7605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:53Z,use_quota=True,user_id='2c80a1c52889463c9f21ae9b476d72ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39188b18-489f-4bc8-af4f-4f45d0b1999a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39188b18-489f-4bc8-af4f-4f45d0b1999a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c3a84bb-31f7-4b81-ad97-ee54b7b918a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c3a84bb-31f7-4b81-ad97-ee54b7b918a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45183033-2ba6-4508-b0ca-d0f0e1fb2034', 'volume_name': 'volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b210ec-037b-4b3d-915d-4557ac0f6123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b210ec-037b-4b3d-915d-4557ac0f6123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d9b9b7-a595-4aba-ac61-64c68902be37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:52 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Volume 45183033-2ba6-4508-b0ca-d0f0e1fb2034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034', 'volume_size': 1} Jul 03 14:04:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:53 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-be60577b-65e8-4cfa-b6d5-be6f83af7766 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf 1G" returned: 0 in 1.384s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-be60577b-65e8-4cfa-b6d5-be6f83af7766 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:53 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf Jul 03 14:04:53 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:53 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-be60577b-65e8-4cfa-b6d5-be6f83af7766 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf" returned: 0 in 0.765s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:53 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-be60577b-65e8-4cfa-b6d5-be6f83af7766 tempest-SnapshotsActionsTest-184183765 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf is being set with open permissions: ugo+rw Jul 03 14:04:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-be60577b-65e8-4cfa-b6d5-be6f83af7766 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:53 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf Jul 03 14:04:53 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:54 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-be60577b-65e8-4cfa-b6d5-be6f83af7766 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf" returned: 0 in 0.680s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-be60577b-65e8-4cfa-b6d5-be6f83af7766 tempest-SnapshotsActionsTest-184183765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.176s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.738s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:54 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1561120960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45183033-2ba6-4508-b0ca-d0f0e1fb2034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d97cde72b04d549489d5c81edc7605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:53Z,use_quota=True,user_id='2c80a1c52889463c9f21ae9b476d72ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:04:54 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Creating volume 45183033-2ba6-4508-b0ca-d0f0e1fb2034 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:04:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:54 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:54 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:54 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:04:54 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:04:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:54 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 1073741824 Jul 03 14:04:54 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:54 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-be60577b-65e8-4cfa-b6d5-be6f83af7766 tempest-SnapshotsActionsTest-184183765 None] Create snapshot completed successfully Jul 03 14:04:55 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 1073741824" returned: 0 in 0.886s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:55 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 Jul 03 14:04:55 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:55 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Acquiring lock "cinder-06270726-4d2a-4683-b599-a3b22786bacf-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:55 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-06270726-4d2a-4683-b599-a3b22786bacf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:55 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Acquiring lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Acquiring lock "cinder-quobyte-06270726-4d2a-4683-b599-a3b22786bacf" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-quobyte-06270726-4d2a-4683-b599-a3b22786bacf" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Deleting offline snapshot 06270726-4d2a-4683-b599-a3b22786bacf of volume 71b9d5f0-2ffd-49c2-9880-ed0d67ded53e {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] snapshot_file for this snap is: volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cea2a23-8d31-4ff6-ae39-6be6bcbd9a71]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Flow 'volume_create_manager' (ef4e44f6-997d-4586-9ef3-70cea11e4967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab1c6c1-b288-49d9-9d6a-7f9754092beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab1c6c1-b288-49d9-9d6a-7f9754092beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1379080283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9778fea1-008a-4ef8-b6c7-4be34b7ca8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68193b44ece144099e490f3d562a5965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:56Z,use_quota=True,user_id='da5671a1c1a54768978e6a123abd4815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(178d482f-9c1a-48d7-9244-8c27b5c6a3f0),volume_type_id=178d482f-9c1a-48d7-9244-8c27b5c6a3f0)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4768d35c-e50d-4629-947c-7aebde7ec898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4768d35c-e50d-4629-947c-7aebde7ec898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5a4750-dfa0-401b-8870-fb584b0dcb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5a4750-dfa0-401b-8870-fb584b0dcb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9778fea1-008a-4ef8-b6c7-4be34b7ca8d6', 'volume_name': 'volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335446cc-2fe8-472b-a29f-1181e3bbbb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335446cc-2fe8-472b-a29f-1181e3bbbb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8383f4b1-882d-4c34-a536-fd3e555c2f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:56 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Volume 9778fea1-008a-4ef8-b6c7-4be34b7ca8d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6', 'volume_size': 1} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:56 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf Jul 03 14:04:56 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:56 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034" returned: 0 in 0.839s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.214s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1379080283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9778fea1-008a-4ef8-b6c7-4be34b7ca8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68193b44ece144099e490f3d562a5965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:56Z,use_quota=True,user_id='da5671a1c1a54768978e6a123abd4815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(178d482f-9c1a-48d7-9244-8c27b5c6a3f0),volume_type_id=178d482f-9c1a-48d7-9244-8c27b5c6a3f0)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Creating volume 9778fea1-008a-4ef8-b6c7-4be34b7ca8d6 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:04:56 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:56 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6 1073741824 Jul 03 14:04:56 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d9b9b7-a595-4aba-ac61-64c68902be37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c14ced2-2594-4645-b360-2b9ee4ce96ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:56 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Volume volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 (45183033-2ba6-4508-b0ca-d0f0e1fb2034): created successfully Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c14ced2-2594-4645-b360-2b9ee4ce96ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Flow 'volume_create_manager' (a37d271a-1851-455b-8003-4d93c4b1d079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:56 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-01214c75-febf-4d9b-915c-e0d7360746bc tempest-VolumeDependencyTests-1129456489 None] Created volume successfully. Jul 03 14:04:56 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:04:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Flow 'volume_create_manager' (e02a6999-05dc-411c-89ea-7cba04260169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f2eda1-fb5d-420f-a535-4c6fb8ef57d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f2eda1-fb5d-420f-a535-4c6fb8ef57d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1621577623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ceba7e2-b422-4980-b604-46e85782c2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68193b44ece144099e490f3d562a5965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:57Z,use_quota=True,user_id='da5671a1c1a54768978e6a123abd4815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53fcb23f-4d10-4697-a735-a4c849d5df6c),volume_type_id=53fcb23f-4d10-4697-a735-a4c849d5df6c)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f8a820-e527-4d81-9554-09e9880937e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f8a820-e527-4d81-9554-09e9880937e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8435b1-c94a-4257-aee0-c142ea1fe5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8435b1-c94a-4257-aee0-c142ea1fe5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ceba7e2-b422-4980-b604-46e85782c2c1', 'volume_name': 'volume-9ceba7e2-b422-4980-b604-46e85782c2c1', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b1ab8b-93dc-4922-b67b-e8b70213b07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b1ab8b-93dc-4922-b67b-e8b70213b07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17e4ef3-5788-4a1d-a3d0-2f68b6e1619a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:57 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Volume 9ceba7e2-b422-4980-b604-46e85782c2c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ceba7e2-b422-4980-b604-46e85782c2c1', 'volume_size': 1} Jul 03 14:04:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:57 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf" returned: 0 in 1.643s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:57 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:04:57 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df9d0bf-9c48-43d6-87fb-647a6271647c]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:58 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 Jul 03 14:04:58 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:04:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:58 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:04:58 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:58 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6 1073741824" returned: 0 in 2.338s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:59 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6 Jul 03 14:04:59 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Flow 'volume_create_manager' (7126a31a-9ebe-4e2f-8d8f-318793b56f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea640437-c73c-4073-b610-3ec55614bbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea640437-c73c-4073-b610-3ec55614bbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-292427814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ea9347-2b40-4219-9144-9d09b7a05828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68193b44ece144099e490f3d562a5965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:59Z,use_quota=True,user_id='da5671a1c1a54768978e6a123abd4815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db863335-5860-420b-b461-2fc8a8eefa66),volume_type_id=db863335-5860-420b-b461-2fc8a8eefa66)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe91fc6-bfc5-4775-b625-92bb4cff09a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe91fc6-bfc5-4775-b625-92bb4cff09a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d617bc-99bf-4103-9113-783247c82362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG cinder.image.glance [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Creating Keystone auth plugin from conf {{(pid=86805) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 14:04:59 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.109s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:04:59 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695" returned: 0 in 1.904s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:59 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf Jul 03 14:04:59 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d617bc-99bf-4103-9113-783247c82362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '09ea9347-2b40-4219-9144-9d09b7a05828', 'volume_name': 'volume-09ea9347-2b40-4219-9144-9d09b7a05828', 'volume_size': 1, 'image_id': 'b7519142-20d5-45df-923b-68a375d11284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7519142-20d5-45df-923b-68a375d11284', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--781239443', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68193b44ece144099e490f3d562a5965', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7519142-20d5-45df-923b-68a375d11284', 'created_at': datetime.datetime(2026, 7, 3, 12, 4, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 4, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7519142-20d5-45df-923b-68a375d11284/file', 'properties': {}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af4d850-89b0-4fef-bdb4-2cc7865271e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af4d850-89b0-4fef-bdb4-2cc7865271e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73934efe-81dd-42ae-8002-d8299e4d56ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:59 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Volume 09ea9347-2b40-4219-9144-9d09b7a05828: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-09ea9347-2b40-4219-9144-9d09b7a05828', 'volume_size': 1, 'image_id': 'b7519142-20d5-45df-923b-68a375d11284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7519142-20d5-45df-923b-68a375d11284', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--781239443', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68193b44ece144099e490f3d562a5965', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7519142-20d5-45df-923b-68a375d11284', 'created_at': datetime.datetime(2026, 7, 3, 12, 4, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 4, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7519142-20d5-45df-923b-68a375d11284/file', 'properties': {}}, 'image_service': } Jul 03 14:04:59 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Trying to clone 09ea9347-2b40-4219-9144-9d09b7a05828 from image b7519142-20d5-45df-923b-68a375d11284 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7519142-20d5-45df-923b-68a375d11284', 'metadata': {}}]). {{(pid=86805) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6" returned: 0 in 1.136s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:00 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] <== create_volume: return (3649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.656s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.848s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1621577623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ceba7e2-b422-4980-b604-46e85782c2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68193b44ece144099e490f3d562a5965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:57Z,use_quota=True,user_id='da5671a1c1a54768978e6a123abd4815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53fcb23f-4d10-4697-a735-a4c849d5df6c),volume_type_id=53fcb23f-4d10-4697-a735-a4c849d5df6c)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Creating volume 9ceba7e2-b422-4980-b604-46e85782c2c1 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:05:00 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ceba7e2-b422-4980-b604-46e85782c2c1 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:00 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ceba7e2-b422-4980-b604-46e85782c2c1 1073741824 Jul 03 14:05:00 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8383f4b1-882d-4c34-a536-fd3e555c2f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c310ee-9664-4f55-9f3f-7fc5f1378a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:00 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Volume volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6 (9778fea1-008a-4ef8-b6c7-4be34b7ca8d6): created successfully Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c310ee-9664-4f55-9f3f-7fc5f1378a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Flow 'volume_create_manager' (ef4e44f6-997d-4586-9ef3-70cea11e4967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:05:00 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e6702976-fd17-464f-8f59-40d8367f099e tempest-TestInstancesWithCinderVolumes-788149672 None] Created volume successfully. Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4d478982-4a52-4563-9a3b-9608884c1be4 tempest-VolumesActionsTest-1536353181 None] Acquiring lock "cinder-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" by "attach_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4d478982-4a52-4563-9a3b-9608884c1be4 tempest-VolumesActionsTest-1536353181 None] Lock "cinder-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" acquired by "attach_volume" :: waited 0.050s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:00 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4d478982-4a52-4563-9a3b-9608884c1be4 tempest-VolumesActionsTest-1536353181 None] Attaching volume cfd22e58-fca2-4cb8-b071-ee1b6d576efd to instance 718dd7ef-325e-4794-a0b4-8650a0cd1105 at mountpoint /dev/vdb on host None. Jul 03 14:05:00 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4d478982-4a52-4563-9a3b-9608884c1be4 tempest-VolumesActionsTest-1536353181 None] Attach volume completed successfully. Jul 03 14:05:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4d478982-4a52-4563-9a3b-9608884c1be4 tempest-VolumesActionsTest-1536353181 None] Lock "cinder-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" released by "attach_volume" :: held 0.200s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:01 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf" returned: 0 in 1.512s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:01 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf Jul 03 14:05:01 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:01 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f560cec2-1e31-47d2-9880-09ecdd18b389 tempest-VolumesActionsTest-1536353181 None] Acquiring lock "cinder-cfd22e58-fca2-4cb8-b071-ee1b6d576efd-detach_volume" by "detach_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:01 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f560cec2-1e31-47d2-9880-09ecdd18b389 tempest-VolumesActionsTest-1536353181 None] Lock "cinder-cfd22e58-fca2-4cb8-b071-ee1b6d576efd-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:01 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f560cec2-1e31-47d2-9880-09ecdd18b389 tempest-VolumesActionsTest-1536353181 None] Detaching volume cfd22e58-fca2-4cb8-b071-ee1b6d576efd from instance 718dd7ef-325e-4794-a0b4-8650a0cd1105. Jul 03 14:05:01 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f560cec2-1e31-47d2-9880-09ecdd18b389 tempest-VolumesActionsTest-1536353181 None] Detach volume completed successfully. Jul 03 14:05:01 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f560cec2-1e31-47d2-9880-09ecdd18b389 tempest-VolumesActionsTest-1536353181 None] Lock "cinder-cfd22e58-fca2-4cb8-b071-ee1b6d576efd-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:01 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ceba7e2-b422-4980-b604-46e85782c2c1 1073741824" returned: 0 in 1.560s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ceba7e2-b422-4980-b604-46e85782c2c1 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:01 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ceba7e2-b422-4980-b604-46e85782c2c1 Jul 03 14:05:01 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:02 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.06270726-4d2a-4683-b599-a3b22786bacf" returned: 0 in 1.060s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:02 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-quobyte-06270726-4d2a-4683-b599-a3b22786bacf" released by "_delete_snapshot" :: held 6.318s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:02 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" released by "delete_snapshot" :: held 6.351s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:02 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Created reservations ['209c50bd-2c4a-4047-b40c-29942540a34c', '78195ac2-475d-46f2-a22e-9c8171a1d083', '69264d55-b171-4c05-b06c-054e2b493232', 'f6db72e7-a232-4e2d-a522-67b05cd5218d'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:05:02 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Delete snapshot completed successfully. Jul 03 14:05:02 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cd397883-d7cf-472c-b7e3-a59dcfe0fe45 tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-06270726-4d2a-4683-b599-a3b22786bacf-delete_snapshot" released by "delete_snapshot" :: held 6.599s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:02 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ceba7e2-b422-4980-b604-46e85782c2c1" returned: 0 in 1.177s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] <== create_volume: return (2795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:05:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.800s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.890s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17e4ef3-5788-4a1d-a3d0-2f68b6e1619a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ceba7e2-b422-4980-b604-46e85782c2c1', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd22a3b7-2ccb-4ed4-b23b-cdb1bd0fe7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] Creating offline snapshot cdc5e748-7181-4485-be06-59beb8de9f22 of volume 45183033-2ba6-4508-b0ca-d0f0e1fb2034 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:05:02 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb1b596-aee0-412c-8751-870263c03feb]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:03 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Volume volume-9ceba7e2-b422-4980-b604-46e85782c2c1 (9ceba7e2-b422-4980-b604-46e85782c2c1): created successfully Jul 03 14:05:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd22a3b7-2ccb-4ed4-b23b-cdb1bd0fe7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Flow 'volume_create_manager' (e02a6999-05dc-411c-89ea-7cba04260169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:05:03 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-bf1901e6-e87c-49c3-a3b2-5ffa05b5f053 tempest-TestInstancesWithCinderVolumes-788149672 None] Created volume successfully. Jul 03 14:05:03 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 Jul 03 14:05:03 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:04 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034" returned: 0 in 1.133s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fb7c065c-452b-4e4a-a746-ff9e1fb2e012 tempest-SnapshotsActionsTest-184183765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:04 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22 1G Jul 03 14:05:04 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:04 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7519142-20d5-45df-923b-68a375d11284_bltgu195devstack@QuobyteHD, size 20.69 MB, duration 4.92 sec {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 14:05:04 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Image download 20.69 MB at 4.21 MB/s Jul 03 14:05:04 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e520b0a-3ff0-461b-87a3-f171a8ccab26]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7519142-20d5-45df-923b-68a375d11284_bltgu195devstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:04 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7519142-20d5-45df-923b-68a375d11284_bltgu195devstack@QuobyteHD Jul 03 14:05:04 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:05 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22 1G" returned: 0 in 0.925s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:05 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22 Jul 03 14:05:05 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:05 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7519142-20d5-45df-923b-68a375d11284_bltgu195devstack@QuobyteHD" returned: 0 in 0.918s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:05 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Temporary image b7519142-20d5-45df-923b-68a375d11284 is fetched for user da5671a1c1a54768978e6a123abd4815. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 14:05:05 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e71fd0d-194b-4ef2-a339-de6922532757]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7519142-20d5-45df-923b-68a375d11284_bltgu195devstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:05 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22" returned: 0 in 0.808s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:05 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22 is being set with open permissions: ugo+rw Jul 03 14:05:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:05 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22 Jul 03 14:05:05 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:05 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7519142-20d5-45df-923b-68a375d11284_bltgu195devstack@QuobyteHD Jul 03 14:05:05 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:06 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22" returned: 0 in 0.662s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:06 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7519142-20d5-45df-923b-68a375d11284_bltgu195devstack@QuobyteHD" returned: 0 in 0.779s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:06 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.info Jul 03 14:05:06 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:07 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.info" returned: 0 in 0.645s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:07 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.info is being set with open permissions: ugo+rw Jul 03 14:05:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:07 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.info Jul 03 14:05:07 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:07 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.info" returned: 0 in 0.626s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.950s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fb7c065c-452b-4e4a-a746-ff9e1fb2e012 tempest-SnapshotsActionsTest-184183765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.696s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-fb7c065c-452b-4e4a-a746-ff9e1fb2e012 tempest-SnapshotsActionsTest-184183765 None] Creating offline snapshot 61693af5-30ad-4e8a-92b3-71a486ca56d1 of volume 71b9d5f0-2ffd-49c2-9880-ed0d67ded53e {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:05:07 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-77dcb83f-b7fa-4055-b18b-15e0940dab0a tempest-VolumeDependencyTests-1129456489 None] Create snapshot completed successfully Jul 03 14:05:07 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dd8a57-b04f-420f-a115-87b37f623f3a]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fb7c065c-452b-4e4a-a746-ff9e1fb2e012 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:08 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 Jul 03 14:05:08 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:08 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fb7c065c-452b-4e4a-a746-ff9e1fb2e012 tempest-SnapshotsActionsTest-184183765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695" returned: 0 in 0.771s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-fb7c065c-452b-4e4a-a746-ff9e1fb2e012 tempest-SnapshotsActionsTest-184183765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:05:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fb7c065c-452b-4e4a-a746-ff9e1fb2e012 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:08 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1 1G Jul 03 14:05:08 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:09 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:05:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Flow 'volume_create_manager' (9e74e228-91d4-4488-9ab7-5e90b0f6a127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:05:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d54502b-e6ce-4c78-9bb2-252dcb55b278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d54502b-e6ce-4c78-9bb2-252dcb55b278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-684399180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d97cde72b04d549489d5c81edc7605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cdc5e748-7181-4485-be06-59beb8de9f22,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:05:09Z,use_quota=True,user_id='2c80a1c52889463c9f21ae9b476d72ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3d2fed-a64a-4abf-bef3-bcfc9c056aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3d2fed-a64a-4abf-bef3-bcfc9c056aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb682ca7-3e0e-44fc-b6d9-a2236ebc3810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb682ca7-3e0e-44fc-b6d9-a2236ebc3810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a', 'volume_name': 'volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a', 'volume_size': 1, 'snapshot_id': 'cdc5e748-7181-4485-be06-59beb8de9f22'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5324f61-eec7-4bb1-a3a3-a07c44ca8b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5324f61-eec7-4bb1-a3a3-a07c44ca8b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b30711e-a62a-4a80-a98a-c33b617222f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:09 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Volume 6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a', 'volume_size': 1, 'snapshot_id': 'cdc5e748-7181-4485-be06-59beb8de9f22'} Jul 03 14:05:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:09 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fb7c065c-452b-4e4a-a746-ff9e1fb2e012 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1 1G" returned: 0 in 0.999s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fb7c065c-452b-4e4a-a746-ff9e1fb2e012 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:09 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1 Jul 03 14:05:09 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:10 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fb7c065c-452b-4e4a-a746-ff9e1fb2e012 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1" returned: 0 in 0.679s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:10 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-fb7c065c-452b-4e4a-a746-ff9e1fb2e012 tempest-SnapshotsActionsTest-184183765 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1 is being set with open permissions: ugo+rw Jul 03 14:05:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fb7c065c-452b-4e4a-a746-ff9e1fb2e012 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:10 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1 Jul 03 14:05:10 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e53e10b5-d6c2-44e5-8565-363507cbc8d4 tempest-VolumesActionsTest-1536353181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:11 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fb7c065c-452b-4e4a-a746-ff9e1fb2e012 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1" returned: 0 in 0.652s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fb7c065c-452b-4e4a-a746-ff9e1fb2e012 tempest-SnapshotsActionsTest-184183765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.208s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.475s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-292427814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ea9347-2b40-4219-9144-9d09b7a05828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68193b44ece144099e490f3d562a5965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:59Z,use_quota=True,user_id='da5671a1c1a54768978e6a123abd4815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db863335-5860-420b-b461-2fc8a8eefa66),volume_type_id=db863335-5860-420b-b461-2fc8a8eefa66)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Creating volume 09ea9347-2b40-4219-9144-9d09b7a05828 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:05:11 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:11 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 1073741824 Jul 03 14:05:11 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:11 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-fb7c065c-452b-4e4a-a746-ff9e1fb2e012 tempest-SnapshotsActionsTest-184183765 None] Create snapshot completed successfully Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Acquiring lock "cinder-61693af5-30ad-4e8a-92b3-71a486ca56d1-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-61693af5-30ad-4e8a-92b3-71a486ca56d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Acquiring lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Acquiring lock "cinder-quobyte-61693af5-30ad-4e8a-92b3-71a486ca56d1" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-quobyte-61693af5-30ad-4e8a-92b3-71a486ca56d1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Deleting offline snapshot 61693af5-30ad-4e8a-92b3-71a486ca56d1 of volume 71b9d5f0-2ffd-49c2-9880-ed0d67ded53e {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] snapshot_file for this snap is: volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbcfa23-281e-4bfb-ad2b-d6eb2a8c63dc]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:11 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1 Jul 03 14:05:11 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:11 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 1073741824" returned: 0 in 0.832s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:12 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 Jul 03 14:05:12 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:12 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1" returned: 0 in 0.762s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd9597e-3848-4797-992c-87c339a8fd28]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:12 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 Jul 03 14:05:12 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:12 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828" returned: 0 in 0.735s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.572s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Acquiring lock "cinder-quobyte-cdc5e748-7181-4485-be06-59beb8de9f22-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a" by "_create_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-quobyte-cdc5e748-7181-4485-be06-59beb8de9f22-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Creating volume 6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a from snapshot cdc5e748-7181-4485-be06-59beb8de9f22 {{(pid=86805) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Acquiring lock "cinder-quobyte-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a" by "_copy_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-quobyte-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] snapshot: cdc5e748-7181-4485-be06-59beb8de9f22, volume: 6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a, {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Attempting download of b7519142-20d5-45df-923b-68a375d11284 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7519142-20d5-45df-923b-68a375d11284', 'metadata': {}}])) to volume 09ea9347-2b40-4219-9144-9d09b7a05828. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f906540b-336d-48c0-aa61-259b690dddc3]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc15212d-6a90-4d30-aff6-35c42752467e]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7519142-20d5-45df-923b-68a375d11284_89ppcti_ {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:12 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22 Jul 03 14:05:12 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:12 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7519142-20d5-45df-923b-68a375d11284_89ppcti_ Jul 03 14:05:12 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:13 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695" returned: 0 in 0.820s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:05:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:13 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1 Jul 03 14:05:13 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:13 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:13 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7519142-20d5-45df-923b-68a375d11284_89ppcti_" returned: 0 in 0.779s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7519142-20d5-45df-923b-68a375d11284_89ppcti_ {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22" returned: 0 in 0.826s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:05:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] will copy from snapshot at /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 14:05:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Creating direct copy from snapshot {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 14:05:13 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3594a0f-4e30-487f-bd2d-fa0a73040ccb]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:13 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7519142-20d5-45df-923b-68a375d11284_89ppcti_ Jul 03 14:05:13 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:13 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 Jul 03 14:05:13 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:14 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1" returned: 0 in 0.758s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:14 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1 Jul 03 14:05:14 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:14 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7519142-20d5-45df-923b-68a375d11284_89ppcti_" returned: 1 in 0.789s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7519142-20d5-45df-923b-68a375d11284_89ppcti_' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:05:14 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59ad6b0-f24b-4678-80d6-971e8618338f]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7519142-20d5-45df-923b-68a375d11284_bltgu195devstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:14 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034" returned: 0 in 0.776s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:14 devstack cinder-volume[86805]: DEBUG cinder.utils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Path /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a not found in is_blk_device check {{(pid=86805) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 14:05:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:14 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a Jul 03 14:05:14 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:14 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7519142-20d5-45df-923b-68a375d11284_bltgu195devstack@QuobyteHD Jul 03 14:05:14 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:14 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.61693af5-30ad-4e8a-92b3-71a486ca56d1" returned: 0 in 0.680s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:14 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-quobyte-61693af5-30ad-4e8a-92b3-71a486ca56d1" released by "_delete_snapshot" :: held 3.123s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:14 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" released by "delete_snapshot" :: held 3.146s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:14 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Created reservations ['23916668-309b-4a19-af7f-c0054024ff3c', 'd1b110f0-8d48-4a7c-abaa-163310871b11', '77ffe447-3acf-4e07-a556-d8c7fe4aef01', 'fb73fad0-c010-48ee-b00f-88eb2ac36989'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:05:14 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Delete snapshot completed successfully. Jul 03 14:05:14 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7d85dae6-4888-4276-8c5c-83501b31c68f tempest-SnapshotsActionsTest-1109096359 None] Lock "cinder-61693af5-30ad-4e8a-92b3-71a486ca56d1-delete_snapshot" released by "delete_snapshot" :: held 3.301s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:15 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7519142-20d5-45df-923b-68a375d11284_bltgu195devstack@QuobyteHD" returned: 0 in 0.957s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:15 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] b7519142-20d5-45df-923b-68a375d11284 was qcow2, converting to raw {{(pid=86805) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 14:05:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7519142-20d5-45df-923b-68a375d11284_bltgu195devstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:15 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7519142-20d5-45df-923b-68a375d11284_bltgu195devstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 Jul 03 14:05:15 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] Acquiring lock "cinder-11ff8b7e-a4eb-4ab2-a1fb-e29581452695-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] Lock "cinder-11ff8b7e-a4eb-4ab2-a1fb-e29581452695-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] Acquiring lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] Lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] Acquiring lock "cinder-quobyte-11ff8b7e-a4eb-4ab2-a1fb-e29581452695" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] Lock "cinder-quobyte-11ff8b7e-a4eb-4ab2-a1fb-e29581452695" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] Deleting offline snapshot 11ff8b7e-a4eb-4ab2-a1fb-e29581452695 of volume 71b9d5f0-2ffd-49c2-9880-ed0d67ded53e {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:05:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] snapshot_file for this snap is: volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:05:17 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a296d3e8-087c-4883-bd96-bad089b4c252]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:17 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 Jul 03 14:05:17 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:18 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695" returned: 0 in 1.452s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:05:18 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2454790b-36d9-4385-adf7-6e30e4a8c59e]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:18 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e Jul 03 14:05:18 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:20 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7519142-20d5-45df-923b-68a375d11284_bltgu195devstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828" returned: 0 in 4.736s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:20 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7519142-20d5-45df-923b-68a375d11284_bltgu195devstack@QuobyteHD, size 112.00 MB, duration 4.74 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:05:20 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Converted 112.00 MB image at 23.64 MB/s Jul 03 14:05:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:20 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 1G Jul 03 14:05:20 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:20 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a" returned: 0 in 5.745s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:20 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:20 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c63025-b4fc-4c61-9a4d-0d6acfe6fa8f]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" returned: 0 in 1.502s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:20 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 Jul 03 14:05:20 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:20 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 Jul 03 14:05:20 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:20 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 1G" returned: 0 in 0.696s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:20 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32c4a1c-e442-45bd-93c0-0a76e54ef37b]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:21 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:21 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 Jul 03 14:05:21 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695" returned: 0 in 0.770s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:21 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695 Jul 03 14:05:21 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:21 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034" returned: 0 in 1.010s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Image conversion details: src /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:05:21 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Converted 1024.00 MB image at 178.19 MB/s Jul 03 14:05:21 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a is being set with open permissions: ugo+rw Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:21 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a Jul 03 14:05:21 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:21 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828" returned: 0 in 0.808s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:21 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e.11ff8b7e-a4eb-4ab2-a1fb-e29581452695" returned: 0 in 0.715s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] Lock "cinder-quobyte-11ff8b7e-a4eb-4ab2-a1fb-e29581452695" released by "_delete_snapshot" :: held 4.664s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] Lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" released by "delete_snapshot" :: held 4.701s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:21 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 Jul 03 14:05:21 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] Created reservations ['3266072d-8ff1-49ce-adbf-4c0eb0a481e9', 'cdec27c3-2099-4dc7-97d0-6fc9ccc63d30', 'bbd1ea72-9d59-4a6d-b887-b652a6010c47', '5d244acc-4bd6-48d4-94d8-b6ad28501092'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:05:21 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a" returned: 0 in 0.643s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-quobyte-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a" released by "_copy_volume_from_snapshot" :: held 9.130s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-quobyte-cdc5e748-7181-4485-be06-59beb8de9f22-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a" released by "_create_volume_from_snapshot" :: held 9.180s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.202s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e53e10b5-d6c2-44e5-8565-363507cbc8d4 tempest-VolumesActionsTest-1536353181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 11.455s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd3214d-f558-4709-a29f-c0b9a7c92fe8]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e53e10b5-d6c2-44e5-8565-363507cbc8d4 tempest-VolumesActionsTest-1536353181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b30711e-a62a-4a80-a98a-c33b617222f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a', 'volume_size': 1, 'snapshot_id': 'cdc5e748-7181-4485-be06-59beb8de9f22'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e1bee5-eb26-4840-88ea-475f5b7b6d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:21 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] Delete snapshot completed successfully. Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7671a444-bec0-4d54-8f40-5246c0faa083 tempest-SnapshotsActionsTest-184183765 None] Lock "cinder-11ff8b7e-a4eb-4ab2-a1fb-e29581452695-delete_snapshot" released by "delete_snapshot" :: held 4.971s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:22 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Volume volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a (6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a): created successfully Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e1bee5-eb26-4840-88ea-475f5b7b6d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Flow 'volume_create_manager' (9e74e228-91d4-4488-9ab7-5e90b0f6a127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:05:22 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-671101f7-a257-4fbd-ada2-23ef700cc70e tempest-VolumeDependencyTests-1129456489 None] Created volume successfully. Jul 03 14:05:22 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd Jul 03 14:05:22 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] Acquiring lock "cinder-cdc5e748-7181-4485-be06-59beb8de9f22-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-cdc5e748-7181-4485-be06-59beb8de9f22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] Acquiring lock "cinder-quobyte-45183033-2ba6-4508-b0ca-d0f0e1fb2034" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-quobyte-45183033-2ba6-4508-b0ca-d0f0e1fb2034" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] Acquiring lock "cinder-quobyte-cdc5e748-7181-4485-be06-59beb8de9f22" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-quobyte-cdc5e748-7181-4485-be06-59beb8de9f22" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] Deleting offline snapshot cdc5e748-7181-4485-be06-59beb8de9f22 of volume 45183033-2ba6-4508-b0ca-d0f0e1fb2034 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] snapshot_file for this snap is: volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf911bd-c67a-4291-b849-9732d8d628d1]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] Acquiring lock "cinder-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] Lock "cinder-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:22 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22 Jul 03 14:05:22 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] Acquiring lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] Lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" acquired by "delete_volume" :: waited 0.021s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db80852-bf08-4d3c-8f7b-76376e7cd7cf]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:22 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828" returned: 1 in 0.954s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Downloaded image b7519142-20d5-45df-923b-68a375d11284 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7519142-20d5-45df-923b-68a375d11284', 'metadata': {}}])) to volume 09ea9347-2b40-4219-9144-9d09b7a05828 successfully. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Temporary image b7519142-20d5-45df-923b-68a375d11284 for user da5671a1c1a54768978e6a123abd4815 is deleted. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Marking volume 09ea9347-2b40-4219-9144-9d09b7a05828 as bootable. {{(pid=86805) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Copying metadata from image b7519142-20d5-45df-923b-68a375d11284 to 09ea9347-2b40-4219-9144-9d09b7a05828. {{(pid=86805) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Creating volume glance metadata for volume 09ea9347-2b40-4219-9144-9d09b7a05828 backed by image b7519142-20d5-45df-923b-68a375d11284 with: {'image_id': 'b7519142-20d5-45df-923b-68a375d11284', 'image_name': 'tempest-scenario-img--781239443', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86805) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 14:05:22 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e Jul 03 14:05:22 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73934efe-81dd-42ae-8002-d8299e4d56ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ea9347-2b40-4219-9144-9d09b7a05828', 'volume_size': 1, 'image_id': 'b7519142-20d5-45df-923b-68a375d11284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7519142-20d5-45df-923b-68a375d11284', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--781239443', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68193b44ece144099e490f3d562a5965', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7519142-20d5-45df-923b-68a375d11284', 'created_at': datetime.datetime(2026, 7, 3, 12, 4, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 4, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7519142-20d5-45df-923b-68a375d11284/file', 'properties': {}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0663679-a62b-4821-811f-a25bbb00abf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:22 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Volume volume-09ea9347-2b40-4219-9144-9d09b7a05828 (09ea9347-2b40-4219-9144-9d09b7a05828): created successfully Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0663679-a62b-4821-811f-a25bbb00abf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Flow 'volume_create_manager' (7126a31a-9ebe-4e2f-8d8f-318793b56f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:05:22 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-c73c088d-d957-4dd2-923e-6cf04ce2d894 tempest-TestInstancesWithCinderVolumes-788149672 None] Created volume successfully. Jul 03 14:05:22 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e53e10b5-d6c2-44e5-8565-363507cbc8d4 tempest-VolumesActionsTest-1536353181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" returned: 0 in 0.971s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce88937-b799-46a9-bba8-f4a92ae82239]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e53e10b5-d6c2-44e5-8565-363507cbc8d4 tempest-VolumesActionsTest-1536353181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:23 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd Jul 03 14:05:23 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:23 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22" returned: 0 in 0.910s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:05:23 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[113d3711-cb59-4cf4-85c7-d223d8efad0d]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:23 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 Jul 03 14:05:23 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:23 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" returned: 0 in 0.941s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:23 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e Jul 03 14:05:23 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:23 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e53e10b5-d6c2-44e5-8565-363507cbc8d4 tempest-VolumesActionsTest-1536353181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" returned: 0 in 0.888s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e53e10b5-d6c2-44e5-8565-363507cbc8d4 tempest-VolumesActionsTest-1536353181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.252fdc90-f432-47eb-ae27-4cba928e38b80f_tlh0p.img {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:23 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.252fdc90-f432-47eb-ae27-4cba928e38b80f_tlh0p.img Jul 03 14:05:23 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:24 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034" returned: 0 in 0.846s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:24 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22 Jul 03 14:05:24 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:24 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" returned: 0 in 0.951s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] Lock "cinder-quobyte-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e" released by "delete_volume" :: held 2.000s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:24 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] Created reservations ['eeea6136-22a9-4947-b9a3-4b65a9e395f0', 'd1b49b06-79a6-409b-a7ff-e211cd08da6f', 'd637ef8b-e128-4980-becc-5f35b5fef894', '659c40fe-1a29-44f2-a6c2-17b64b04117e'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:05:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:05:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:05:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:24 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:05:24 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:25 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22" returned: 0 in 1.796s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:26 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22 Jul 03 14:05:26 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:26 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.271s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:26 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:05:26 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] Deleted volume successfully. Jul 03 14:05:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-35b87141-b971-4a90-96b0-c6748cf20b19 tempest-SnapshotsActionsTest-184183765 None] Lock "cinder-71b9d5f0-2ffd-49c2-9880-ed0d67ded53e-delete_volume" released by "delete_volume" :: held 3.764s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:27 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034.cdc5e748-7181-4485-be06-59beb8de9f22" returned: 0 in 1.513s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-quobyte-cdc5e748-7181-4485-be06-59beb8de9f22" released by "_delete_snapshot" :: held 5.272s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-quobyte-45183033-2ba6-4508-b0ca-d0f0e1fb2034" released by "delete_snapshot" :: held 5.303s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:27 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] Created reservations ['2720321b-2b40-4cf4-b579-0922587d15e5', '97717e26-06f9-483c-8a49-e540928e4d76', '49b2c936-c236-46da-a790-423563f66681', '01095459-ae75-4012-a398-2d0eb4230dbf'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:05:27 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] Delete snapshot completed successfully. Jul 03 14:05:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-09e2aaad-fc54-45bd-8937-6b302fe967b1 tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-cdc5e748-7181-4485-be06-59beb8de9f22-delete_snapshot" released by "delete_snapshot" :: held 5.651s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] Acquiring lock "cinder-45183033-2ba6-4508-b0ca-d0f0e1fb2034-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-45183033-2ba6-4508-b0ca-d0f0e1fb2034-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] Acquiring lock "cinder-quobyte-45183033-2ba6-4508-b0ca-d0f0e1fb2034" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-quobyte-45183033-2ba6-4508-b0ca-d0f0e1fb2034" acquired by "delete_volume" :: waited 0.031s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:29 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1043f9e9-181d-4a43-aa1a-e94765d00c9a]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:29 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 Jul 03 14:05:29 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:30 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e53e10b5-d6c2-44e5-8565-363507cbc8d4 tempest-VolumesActionsTest-1536353181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.252fdc90-f432-47eb-ae27-4cba928e38b80f_tlh0p.img" returned: 0 in 6.444s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:30 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a9f887-c87f-4428-9437-36df8512ed1b]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e53e10b5-d6c2-44e5-8565-363507cbc8d4 tempest-VolumesActionsTest-1536353181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:30 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd Jul 03 14:05:30 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:30 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034" returned: 0 in 1.402s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:30 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034 Jul 03 14:05:30 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:31 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e53e10b5-d6c2-44e5-8565-363507cbc8d4 tempest-VolumesActionsTest-1536353181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" returned: 0 in 1.375s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:31 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-e53e10b5-d6c2-44e5-8565-363507cbc8d4 tempest-VolumesActionsTest-1536353181 None] Image conversion details: src /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd, size 1024.00 MB, duration 6.45 sec, destination /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.252fdc90-f432-47eb-ae27-4cba928e38b80f_tlh0p.img {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:05:31 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-e53e10b5-d6c2-44e5-8565-363507cbc8d4 tempest-VolumesActionsTest-1536353181 None] Converted 1024.00 MB image at 158.81 MB/s Jul 03 14:05:31 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-45183033-2ba6-4508-b0ca-d0f0e1fb2034" returned: 0 in 0.926s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:31 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-e53e10b5-d6c2-44e5-8565-363507cbc8d4 tempest-VolumesActionsTest-1536353181 None] 252fdc90-f432-47eb-ae27-4cba928e38b8 was raw, no need to convert to raw {{(pid=86805) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Jul 03 14:05:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-quobyte-45183033-2ba6-4508-b0ca-d0f0e1fb2034" released by "delete_volume" :: held 2.498s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:31 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] Created reservations ['f1813737-70a4-4c54-be57-2e98dca26f01', 'ec31f41a-957f-443f-afcf-f2af3780ecdd', 'ec25ad07-a9f8-43f9-834d-4a204cb017c7', '15a950db-49d0-4111-a834-7f248a48d08f'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:05:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-0cd74871-2cdd-4880-854d-1960536aeba6 req-36ac06ce-509c-498f-b0d5-b3b500b1e7f1 tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:05:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:05:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:32 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:05:32 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] Acquiring lock "cinder-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] Acquiring lock "cinder-quobyte-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-quobyte-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a" acquired by "delete_volume" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:32 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae4a945-8ccd-470a-a7a1-bf44c2fcccdd]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:32 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.966s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:33 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:05:33 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] Deleted volume successfully. Jul 03 14:05:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f27f1806-9084-4d92-99e9-9ef228146e7e tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-45183033-2ba6-4508-b0ca-d0f0e1fb2034-delete_volume" released by "delete_volume" :: held 3.924s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:33 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a Jul 03 14:05:33 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:34 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a" returned: 0 in 1.094s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:34 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a Jul 03 14:05:34 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:34 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a" returned: 0 in 0.824s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-quobyte-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a" released by "delete_volume" :: held 1.978s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:34 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] Created reservations ['74ec8cf1-cb21-42d6-949b-a44833f0b95a', 'dcb2e4c7-c53d-4ee0-9e31-d6222a01bf52', '7befd84b-c3ca-417d-8e24-e7631a75ecd6', '20e07460-ce2f-47e3-a45e-8ac7bfd938c9'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:05:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:35 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:05:35 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:05:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:35 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:05:35 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:35 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.720s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:35 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:05:35 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] Deleted volume successfully. Jul 03 14:05:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d1dbb570-1fa6-4f22-831a-e8624b9cd248 tempest-VolumeDependencyTests-1129456489 None] Lock "cinder-6fb5292e-2fbf-473c-9c05-7e12b9ce5f7a-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:05:39 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:05:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Flow 'volume_create_manager' (f531c767-6b1b-44af-a818-175409d6d8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:05:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ae0bc3-61c1-4d66-b3c4-7856dbf4e8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ae0bc3-61c1-4d66-b3c4-7856dbf4e8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8d6d40c2cc4970815f4fe91239e3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:05:40Z,use_quota=True,user_id='ac2f154e097f493fae65a446d4d1b55d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4a46c6-eebe-4a5c-9fba-565768251e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4a46c6-eebe-4a5c-9fba-565768251e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6567b4-057d-431f-8384-5fc24dbd4c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6567b4-057d-431f-8384-5fc24dbd4c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb', 'volume_name': 'volume-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d6fbff-a9a7-418a-9b3d-96fa290f59c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d6fbff-a9a7-418a-9b3d-96fa290f59c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a16f527-bff2-4c28-b6cc-6dc817b69546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:40 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Volume 1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb', 'volume_size': 1} Jul 03 14:05:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:43 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:05:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Flow 'volume_create_manager' (7f42a10e-bf15-4edc-9a41-d4f281f41633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:05:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a599f392-e25a-4d90-a42d-6dc41cbc0074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a599f392-e25a-4d90-a42d-6dc41cbc0074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1561219547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f4a29a-bc83-4128-b1bf-bf69ca715707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb2f7daf69f04e8bb011ae7992432583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:05:44Z,use_quota=True,user_id='5659a5a86c824a7bad84b4733d6565c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db498239-1088-47da-b898-1b11a9b4bfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db498239-1088-47da-b898-1b11a9b4bfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1eb14fe-4ead-4532-a946-2af4f708e488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1eb14fe-4ead-4532-a946-2af4f708e488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f4a29a-bc83-4128-b1bf-bf69ca715707', 'volume_name': 'volume-80f4a29a-bc83-4128-b1bf-bf69ca715707', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53101757-a3e7-4a82-9260-c71f67a62ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53101757-a3e7-4a82-9260-c71f67a62ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5097a076-a394-4602-b229-f63448ce861a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:43 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Volume 80f4a29a-bc83-4128-b1bf-bf69ca715707: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f4a29a-bc83-4128-b1bf-bf69ca715707', 'volume_size': 1} Jul 03 14:05:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e53e10b5-d6c2-44e5-8565-363507cbc8d4 tempest-VolumesActionsTest-1536353181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.351s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e53e10b5-d6c2-44e5-8565-363507cbc8d4 tempest-VolumesActionsTest-1536353181 None] Uploaded volume to glance image-id: 252fdc90-f432-47eb-ae27-4cba928e38b8. {{(pid=86805) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 03 14:05:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-0cd74871-2cdd-4880-854d-1960536aeba6 req-36ac06ce-509c-498f-b0d5-b3b500b1e7f1 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 21.309s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:53 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=66,cinder:DELETE=9,cinder:UPDATE=67,cinder:INSERT=26 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:05:53 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=73,cinder:UPDATE=70,cinder:INSERT=18,cinder:DELETE=2 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:05:53 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5103bb45-f94c-40d5-a926-f5c8b0003352]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-0cd74871-2cdd-4880-854d-1960536aeba6 req-36ac06ce-509c-498f-b0d5-b3b500b1e7f1 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:53 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e53e10b5-d6c2-44e5-8565-363507cbc8d4 tempest-VolumesActionsTest-1536353181 None] Copy volume to image completed successfully. Jul 03 14:05:53 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 Jul 03 14:05:53 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:54 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-0cd74871-2cdd-4880-854d-1960536aeba6 req-36ac06ce-509c-498f-b0d5-b3b500b1e7f1 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828" returned: 0 in 0.782s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-0cd74871-2cdd-4880-854d-1960536aeba6 req-36ac06ce-509c-498f-b0d5-b3b500b1e7f1 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:54 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 Jul 03 14:05:54 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:54 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-0cd74871-2cdd-4880-854d-1960536aeba6 req-36ac06ce-509c-498f-b0d5-b3b500b1e7f1 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828" returned: 1 in 0.722s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-0cd74871-2cdd-4880-854d-1960536aeba6 req-36ac06ce-509c-498f-b0d5-b3b500b1e7f1 tempest-TestInstancesWithCinderVolumes-788149672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:05:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-0cd74871-2cdd-4880-854d-1960536aeba6 req-36ac06ce-509c-498f-b0d5-b3b500b1e7f1 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.577s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.762s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:54 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8d6d40c2cc4970815f4fe91239e3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:05:40Z,use_quota=True,user_id='ac2f154e097f493fae65a446d4d1b55d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:05:54 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Creating volume 1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:05:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:54 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:05:54 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:05:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:54 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:05:54 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:05:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:54 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb 1073741824 Jul 03 14:05:54 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:54 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-0cd74871-2cdd-4880-854d-1960536aeba6 req-36ac06ce-509c-498f-b0d5-b3b500b1e7f1 tempest-TestInstancesWithCinderVolumes-788149672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-09ea9347-2b40-4219-9144-9d09b7a05828', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b879babb-5201-4d0f-a20b-947737db6d92', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:05:54 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-0cd74871-2cdd-4880-854d-1960536aeba6 req-36ac06ce-509c-498f-b0d5-b3b500b1e7f1 tempest-TestInstancesWithCinderVolumes-788149672 None] attachment_update completed successfully. Jul 03 14:05:55 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb 1073741824" returned: 0 in 0.845s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:55 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb Jul 03 14:05:55 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:56 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb" returned: 0 in 0.649s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:05:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.633s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1561219547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f4a29a-bc83-4128-b1bf-bf69ca715707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb2f7daf69f04e8bb011ae7992432583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:05:44Z,use_quota=True,user_id='5659a5a86c824a7bad84b4733d6565c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:05:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Creating volume 80f4a29a-bc83-4128-b1bf-bf69ca715707 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:05:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:05:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:05:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:05:56 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:05:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80f4a29a-bc83-4128-b1bf-bf69ca715707 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a16f527-bff2-4c28-b6cc-6dc817b69546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:56 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80f4a29a-bc83-4128-b1bf-bf69ca715707 1073741824 Jul 03 14:05:56 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17c7f09-a353-41c4-951f-1aa63d73ddf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:56 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Volume volume-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb (1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb): created successfully Jul 03 14:05:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17c7f09-a353-41c4-951f-1aa63d73ddf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:56 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Flow 'volume_create_manager' (f531c767-6b1b-44af-a818-175409d6d8a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:05:56 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-6fa7fe66-d3e0-4384-a7e8-6b030bdb2a9f tempest-CinderUnicodeTest-1454687044 None] Created volume successfully. Jul 03 14:05:57 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80f4a29a-bc83-4128-b1bf-bf69ca715707 1073741824" returned: 0 in 0.966s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:57 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:05:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Flow 'volume_create_manager' (fa85c66e-4052-429b-bf26-f7e679fa34dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:05:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525f229c-8e0f-44f0-b296-b9cb7477f992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525f229c-8e0f-44f0-b296-b9cb7477f992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:05:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-80228623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9ada41-ca83-4128-9053-f79a5cd7a70d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8d6d40c2cc4970815f4fe91239e3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:05:57Z,use_quota=True,user_id='ac2f154e097f493fae65a446d4d1b55d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd04e3a-5e05-4ea6-a783-360dc3e976f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd04e3a-5e05-4ea6-a783-360dc3e976f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f93ad75-d3f2-4186-8c0e-a76b529581a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f93ad75-d3f2-4186-8c0e-a76b529581a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b9ada41-ca83-4128-9053-f79a5cd7a70d', 'volume_name': 'volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73c2bf7-3995-4421-89fd-4bad511be027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73c2bf7-3995-4421-89fd-4bad511be027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7416c9-e13e-4e53-a8a2-c5d535654c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:57 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Volume 1b9ada41-ca83-4128-9053-f79a5cd7a70d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d', 'volume_size': 1} Jul 03 14:05:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80f4a29a-bc83-4128-b1bf-bf69ca715707 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:57 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80f4a29a-bc83-4128-b1bf-bf69ca715707 Jul 03 14:05:57 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:58 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80f4a29a-bc83-4128-b1bf-bf69ca715707" returned: 0 in 0.699s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:05:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.616s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:58 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca495841-55bb-4a7a-a519-8ff79760ee74]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:58 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd Jul 03 14:05:58 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:05:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:05:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:05:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:58 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:05:58 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5097a076-a394-4602-b229-f63448ce861a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f4a29a-bc83-4128-b1bf-bf69ca715707', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e996b04-c523-45a5-bcb0-3af57661e94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:58 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Volume volume-80f4a29a-bc83-4128-b1bf-bf69ca715707 (80f4a29a-bc83-4128-b1bf-bf69ca715707): created successfully Jul 03 14:05:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e996b04-c523-45a5-bcb0-3af57661e94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Flow 'volume_create_manager' (7f42a10e-bf15-4edc-9a41-d4f281f41633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:05:58 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f4fc55ad-bba3-4e1b-b36a-ffa775ebcda5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Created volume successfully. Jul 03 14:05:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Acquiring lock "cinder-80f4a29a-bc83-4128-b1bf-bf69ca715707-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:59 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" returned: 0 in 0.910s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:59 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.734s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:05:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Lock "cinder-80f4a29a-bc83-4128-b1bf-bf69ca715707-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:59 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[809fcf61-21cc-48fc-9be0-5976ff6fba91]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Acquiring lock "cinder-quobyte-80f4a29a-bc83-4128-b1bf-bf69ca715707" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:05:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Lock "cinder-quobyte-80f4a29a-bc83-4128-b1bf-bf69ca715707" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:05:59 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1994d8f2-aa43-47db-bc21-189a03c39db1]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80f4a29a-bc83-4128-b1bf-bf69ca715707 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:59 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd Jul 03 14:05:59 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:59 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80f4a29a-bc83-4128-b1bf-bf69ca715707 Jul 03 14:05:59 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:59 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" returned: 0 in 0.798s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.6093f836-63cb-4c61-8f81-48f4ef6aebact2b6ejm8.img {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:59 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.6093f836-63cb-4c61-8f81-48f4ef6aebact2b6ejm8.img Jul 03 14:05:59 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:00 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80f4a29a-bc83-4128-b1bf-bf69ca715707" returned: 0 in 0.842s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80f4a29a-bc83-4128-b1bf-bf69ca715707 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:00 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80f4a29a-bc83-4128-b1bf-bf69ca715707 Jul 03 14:06:00 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:01 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80f4a29a-bc83-4128-b1bf-bf69ca715707" returned: 0 in 1.405s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:01 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Lock "cinder-quobyte-80f4a29a-bc83-4128-b1bf-bf69ca715707" released by "delete_volume" :: held 2.351s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:01 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Created reservations ['488d958f-943b-45bf-ac75-1b10be773e95', '659c9886-f57f-4976-a8de-7ee5bed9dfb3', '3a2fbfef-358b-4ef0-8024-e5d7cf5c57e7', 'da5c3258-1ffa-4e5c-acc8-dbb3bf728ec2'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:06:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:02 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:06:02 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:04 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 2.049s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:04 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:06:04 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Deleted volume successfully. Jul 03 14:06:04 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bbca8620-fd39-4788-bccb-62ba37de04c5 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Lock "cinder-80f4a29a-bc83-4128-b1bf-bf69ca715707-delete_volume" released by "delete_volume" :: held 5.108s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:04 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:06:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Flow 'volume_create_manager' (fd941a8b-69fe-485e-a367-86a0bc709023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047e8f8b-5267-4fe9-b1e6-024de8e4dfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047e8f8b-5267-4fe9-b1e6-024de8e4dfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-794995552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15ea2f2-0b88-493a-83d3-4e4f661fd523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb2f7daf69f04e8bb011ae7992432583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:06:05Z,use_quota=True,user_id='5659a5a86c824a7bad84b4733d6565c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f161500-9492-422d-8ba8-106cff777ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f161500-9492-422d-8ba8-106cff777ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e99ca5-1495-4c88-860a-8918464fbb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e99ca5-1495-4c88-860a-8918464fbb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15ea2f2-0b88-493a-83d3-4e4f661fd523', 'volume_name': 'volume-f15ea2f2-0b88-493a-83d3-4e4f661fd523', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793ca343-c1e4-45a1-a273-5f8802bfdbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793ca343-c1e4-45a1-a273-5f8802bfdbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccb0d63-79f2-4b0f-81e6-0a78e980e831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:05 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Volume f15ea2f2-0b88-493a-83d3-4e4f661fd523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15ea2f2-0b88-493a-83d3-4e4f661fd523', 'volume_size': 1} Jul 03 14:06:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:08 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.6093f836-63cb-4c61-8f81-48f4ef6aebact2b6ejm8.img" returned: 0 in 8.079s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:08 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[569fe018-4d30-4e50-a89e-10695dc95514]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:08 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd Jul 03 14:06:08 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:09 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" returned: 0 in 1.128s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:09 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] Image conversion details: src /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd, size 1024.00 MB, duration 8.08 sec, destination /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.6093f836-63cb-4c61-8f81-48f4ef6aebact2b6ejm8.img {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:06:09 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] Converted 1024.00 MB image at 126.72 MB/s Jul 03 14:06:09 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] 6093f836-63cb-4c61-8f81-48f4ef6aebac was raw, converting to qcow2 {{(pid=86805) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Jul 03 14:06:09 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e35aaea-3323-44be-84cd-732735e7c533]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.6093f836-63cb-4c61-8f81-48f4ef6aebact2b6ejm8.img {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:09 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.6093f836-63cb-4c61-8f81-48f4ef6aebact2b6ejm8.img Jul 03 14:06:09 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:10 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.6093f836-63cb-4c61-8f81-48f4ef6aebact2b6ejm8.img" returned: 0 in 0.936s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.6093f836-63cb-4c61-8f81-48f4ef6aebact2b6ejm8.img {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:10 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.6093f836-63cb-4c61-8f81-48f4ef6aebact2b6ejm8.img Jul 03 14:06:10 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:11 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.6093f836-63cb-4c61-8f81-48f4ef6aebact2b6ejm8.img" returned: 1 in 0.854s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.6093f836-63cb-4c61-8f81-48f4ef6aebact2b6ejm8.img' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:06:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.6093f836-63cb-4c61-8f81-48f4ef6aebact2b6ejm8.img /opt/stack/data/cinder/conversion/vol_upload_rezbsci5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:11 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.6093f836-63cb-4c61-8f81-48f4ef6aebact2b6ejm8.img /opt/stack/data/cinder/conversion/vol_upload_rezbsci5 Jul 03 14:06:11 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:11 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.6093f836-63cb-4c61-8f81-48f4ef6aebact2b6ejm8.img /opt/stack/data/cinder/conversion/vol_upload_rezbsci5" returned: 0 in 0.783s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:11 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] Image conversion details: src /opt/stack/data/cinder/conversion/cfd22e58-fca2-4cb8-b071-ee1b6d576efd.temp_image.6093f836-63cb-4c61-8f81-48f4ef6aebact2b6ejm8.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_rezbsci5 {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:06:11 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 03 14:06:11 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a5d030-c61a-422c-a38a-72bf6d011270]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rezbsci5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:11 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rezbsci5 Jul 03 14:06:11 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:12 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rezbsci5" returned: 0 in 0.780s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.144s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] Uploaded volume to glance image-id: 6093f836-63cb-4c61-8f81-48f4ef6aebac. {{(pid=86805) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 03 14:06:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.867s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:05:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-80228623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9ada41-ca83-4128-9053-f79a5cd7a70d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8d6d40c2cc4970815f4fe91239e3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:05:57Z,use_quota=True,user_id='ac2f154e097f493fae65a446d4d1b55d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:06:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Creating volume 1b9ada41-ca83-4128-9053-f79a5cd7a70d {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:06:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:06:14 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:06:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:14 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d 1073741824 Jul 03 14:06:14 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:14 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-37c205a1-80b0-4fac-a602-7b5e30771182 tempest-VolumesActionsTest-1536353181 None] Copy volume to image completed successfully. Jul 03 14:06:15 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d 1073741824" returned: 0 in 0.992s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:15 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d Jul 03 14:06:15 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] Acquiring lock "cinder-cfd22e58-fca2-4cb8-b071-ee1b6d576efd-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] Lock "cinder-cfd22e58-fca2-4cb8-b071-ee1b6d576efd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] Acquiring lock "cinder-quobyte-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] Lock "cinder-quobyte-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" acquired by "delete_volume" :: waited 0.035s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:15 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c49c18-93c4-4ec6-bbe5-6abca177d570]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:16 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd Jul 03 14:06:16 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:16 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d" returned: 0 in 0.830s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.113s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-794995552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15ea2f2-0b88-493a-83d3-4e4f661fd523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb2f7daf69f04e8bb011ae7992432583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:06:05Z,use_quota=True,user_id='5659a5a86c824a7bad84b4733d6565c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Creating volume f15ea2f2-0b88-493a-83d3-4e4f661fd523 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:06:16 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f15ea2f2-0b88-493a-83d3-4e4f661fd523 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:16 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f15ea2f2-0b88-493a-83d3-4e4f661fd523 1073741824 Jul 03 14:06:16 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7416c9-e13e-4e53-a8a2-c5d535654c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32106d51-b12b-4311-af83-13f9c36adf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:16 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Volume volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d (1b9ada41-ca83-4128-9053-f79a5cd7a70d): created successfully Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32106d51-b12b-4311-af83-13f9c36adf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Flow 'volume_create_manager' (fa85c66e-4052-429b-bf26-f7e679fa34dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:16 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-0be8d0b7-fe20-4bf8-8f5f-b7337b35c6c1 tempest-CinderUnicodeTest-1454687044 None] Created volume successfully. Jul 03 14:06:16 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" returned: 0 in 1.012s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:16 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd Jul 03 14:06:16 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:17 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f15ea2f2-0b88-493a-83d3-4e4f661fd523 1073741824" returned: 0 in 1.133s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f15ea2f2-0b88-493a-83d3-4e4f661fd523 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:17 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f15ea2f2-0b88-493a-83d3-4e4f661fd523 Jul 03 14:06:17 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:17 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" returned: 0 in 0.925s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] Lock "cinder-quobyte-cfd22e58-fca2-4cb8-b071-ee1b6d576efd" released by "delete_volume" :: held 1.988s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:17 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] Created reservations ['ad402f92-a75f-4902-8216-2a77f03a7bb7', '01565e23-6469-4020-b4c0-691495905f93', '4c535e90-5bba-46f8-9ab7-59f46f30b6fe', 'e41fe139-5adc-4ea3-adb8-a162d89e6e47'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:06:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:18 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:06:18 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:18 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f15ea2f2-0b88-493a-83d3-4e4f661fd523" returned: 0 in 0.967s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] <== create_volume: return (2183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:06:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.268s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] Creating offline snapshot 03fd99d2-56e4-4a22-bd8d-d45270720568 of volume 1b9ada41-ca83-4128-9053-f79a5cd7a70d {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:06:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccb0d63-79f2-4b0f-81e6-0a78e980e831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15ea2f2-0b88-493a-83d3-4e4f661fd523', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd1e0ec-fa5e-401a-818d-0cc83ec3b05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:18 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6616827c-7ef3-4dc3-b101-301d22a74253]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:18 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Volume volume-f15ea2f2-0b88-493a-83d3-4e4f661fd523 (f15ea2f2-0b88-493a-83d3-4e4f661fd523): created successfully Jul 03 14:06:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd1e0ec-fa5e-401a-818d-0cc83ec3b05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Flow 'volume_create_manager' (fd941a8b-69fe-485e-a367-86a0bc709023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:18 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-38b36a30-6b8e-48de-b7a1-6dc0be2a7255 tempest-VolumeQuotasAdminTestJSON-2126869309 None] Created volume successfully. Jul 03 14:06:18 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d Jul 03 14:06:18 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:19 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.964s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:19 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:06:19 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] Deleted volume successfully. Jul 03 14:06:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c2b7c9cd-b701-4a3b-ae31-d357b824943e tempest-VolumesActionsTest-1536353181 None] Lock "cinder-cfd22e58-fca2-4cb8-b071-ee1b6d576efd-delete_volume" released by "delete_volume" :: held 3.324s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:19 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d" returned: 0 in 1.204s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:19 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568 1G Jul 03 14:06:19 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:20 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-8ad34a74-f3d4-440f-9b5b-29064937cac9 tempest-VolumeQuotasAdminTestJSON-82140079 None] Transfer volume completed successfully. Jul 03 14:06:20 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568 1G" returned: 0 in 1.220s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:20 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568 Jul 03 14:06:20 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] Acquiring lock "cinder-f15ea2f2-0b88-493a-83d3-4e4f661fd523-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] Lock "cinder-f15ea2f2-0b88-493a-83d3-4e4f661fd523-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] Acquiring lock "cinder-quobyte-f15ea2f2-0b88-493a-83d3-4e4f661fd523" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] Lock "cinder-quobyte-f15ea2f2-0b88-493a-83d3-4e4f661fd523" acquired by "delete_volume" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:21 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[510e6756-205e-4c53-88e7-97f9cbd33869]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f15ea2f2-0b88-493a-83d3-4e4f661fd523 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:21 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568" returned: 0 in 0.797s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:21 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568 is being set with open permissions: ugo+rw Jul 03 14:06:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:21 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568 Jul 03 14:06:21 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:21 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f15ea2f2-0b88-493a-83d3-4e4f661fd523 Jul 03 14:06:21 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:22 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568" returned: 0 in 0.785s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:22 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.info Jul 03 14:06:22 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:22 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f15ea2f2-0b88-493a-83d3-4e4f661fd523" returned: 0 in 0.967s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f15ea2f2-0b88-493a-83d3-4e4f661fd523 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:22 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f15ea2f2-0b88-493a-83d3-4e4f661fd523 Jul 03 14:06:22 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:23 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.info" returned: 0 in 0.753s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:23 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.info is being set with open permissions: ugo+rw Jul 03 14:06:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:23 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f15ea2f2-0b88-493a-83d3-4e4f661fd523" returned: 0 in 0.745s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:23 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.info Jul 03 14:06:23 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] Lock "cinder-quobyte-f15ea2f2-0b88-493a-83d3-4e4f661fd523" released by "delete_volume" :: held 1.785s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:23 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] Created reservations ['3b682ee5-9785-46c5-b26f-18bf5034a7d6', 'c364a72b-b6b5-49c0-b430-759bcafea721', '7df43db6-da63-448d-8fb3-6d1e3c99aa79', 'e4e02c25-822c-4b05-b037-e994937ff0a2'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:06:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:23 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:06:23 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:24 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.info" returned: 0 in 0.951s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.846s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:24 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-81f332b9-0259-4be4-a381-a6c92d090c4c tempest-CinderUnicodeTest-1454687044 None] Create snapshot completed successfully Jul 03 14:06:24 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.850s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:24 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:06:24 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] Deleted volume successfully. Jul 03 14:06:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b362826c-7741-4545-8b31-aeeacdcaf176 tempest-VolumeQuotasAdminTestJSON-288330987 None] Lock "cinder-f15ea2f2-0b88-493a-83d3-4e4f661fd523-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] Acquiring lock "cinder-03fd99d2-56e4-4a22-bd8d-d45270720568-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] Lock "cinder-03fd99d2-56e4-4a22-bd8d-d45270720568-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] Acquiring lock "cinder-quobyte-1b9ada41-ca83-4128-9053-f79a5cd7a70d" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] Lock "cinder-quobyte-1b9ada41-ca83-4128-9053-f79a5cd7a70d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] Acquiring lock "cinder-quobyte-03fd99d2-56e4-4a22-bd8d-d45270720568" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] Lock "cinder-quobyte-03fd99d2-56e4-4a22-bd8d-d45270720568" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] Deleting offline snapshot 03fd99d2-56e4-4a22-bd8d-d45270720568 of volume 1b9ada41-ca83-4128-9053-f79a5cd7a70d {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:06:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] snapshot_file for this snap is: volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:06:24 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[88702d55-d194-4ba0-b2d5-dfa36432a771]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:24 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568 Jul 03 14:06:24 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:25 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568" returned: 0 in 0.838s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:06:25 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[821afe5f-b101-4ee0-abc1-93f3c6f64349]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:25 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d Jul 03 14:06:25 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:26 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d" returned: 0 in 0.975s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:26 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568 Jul 03 14:06:26 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:27 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568" returned: 0 in 1.063s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:27 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568 Jul 03 14:06:27 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:28 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d.03fd99d2-56e4-4a22-bd8d-d45270720568" returned: 0 in 0.924s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] Lock "cinder-quobyte-03fd99d2-56e4-4a22-bd8d-d45270720568" released by "_delete_snapshot" :: held 3.958s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] Lock "cinder-quobyte-1b9ada41-ca83-4128-9053-f79a5cd7a70d" released by "delete_snapshot" :: held 3.999s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:28 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] Created reservations ['59750002-3641-421a-b8f1-3a6432095a79', '94f12c0b-6394-45bb-b6d7-f6f01d78d788', 'df01cd6c-d31a-4929-b2d4-dd91e78f51a8', '3ca91990-1cb9-4209-9af9-7a4cb6bd63eb'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:06:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] Delete snapshot completed successfully. Jul 03 14:06:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-38a7b53a-673b-486f-86e0-1f07954988ee tempest-CinderUnicodeTest-1454687044 None] Lock "cinder-03fd99d2-56e4-4a22-bd8d-d45270720568-delete_snapshot" released by "delete_snapshot" :: held 4.248s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] Acquiring lock "cinder-1b9ada41-ca83-4128-9053-f79a5cd7a70d-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] Lock "cinder-1b9ada41-ca83-4128-9053-f79a5cd7a70d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] Acquiring lock "cinder-quobyte-1b9ada41-ca83-4128-9053-f79a5cd7a70d" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] Lock "cinder-quobyte-1b9ada41-ca83-4128-9053-f79a5cd7a70d" acquired by "delete_volume" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:29 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dea277f-6461-44b2-9112-0ca4b5d12538]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:29 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d Jul 03 14:06:29 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:30 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d" returned: 0 in 0.983s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:30 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d Jul 03 14:06:30 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:30 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b9ada41-ca83-4128-9053-f79a5cd7a70d" returned: 0 in 0.733s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] Lock "cinder-quobyte-1b9ada41-ca83-4128-9053-f79a5cd7a70d" released by "delete_volume" :: held 1.811s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:30 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] Created reservations ['fa37b1d2-e89b-4199-bf8b-8b6a0d1c4b48', '1c591df1-716f-45ce-9e80-09784e2a1df3', 'f6efc115-8a3d-4d45-ae7a-2be1136953ae', '7b0f5a23-9e3a-4daa-9d98-f78f6890cfa2'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:06:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:31 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:06:31 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] Acquiring lock "cinder-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] Lock "cinder-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] Acquiring lock "cinder-quobyte-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] Lock "cinder-quobyte-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb" acquired by "delete_volume" :: waited 0.023s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:31 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4d2cd1-da36-48f2-b27a-8296e51b0b87]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:31 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb Jul 03 14:06:31 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:31 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.783s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:31 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:06:31 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] Deleted volume successfully. Jul 03 14:06:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a1d2ca7f-056c-44dd-b727-e09299ab0f2f tempest-CinderUnicodeTest-1454687044 None] Lock "cinder-1b9ada41-ca83-4128-9053-f79a5cd7a70d-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:32 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb" returned: 0 in 0.985s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:32 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb Jul 03 14:06:32 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:33 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb" returned: 0 in 0.903s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] Lock "cinder-quobyte-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb" released by "delete_volume" :: held 1.946s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:33 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] Created reservations ['cf816a1c-e468-4c20-b382-d52d7a76104f', '4728a230-f9e0-49ff-8440-94e0dc67a718', '664e3a9e-4df3-4ae9-936b-132059b4a5aa', '45211ff9-1574-4165-8b09-85efae9d017e'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:06:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:33 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:06:33 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:34 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.877s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:34 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:06:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] Deleted volume successfully. Jul 03 14:06:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d5e7e163-391c-4717-8f65-cdfcc4ecce3f tempest-CinderUnicodeTest-1454687044 None] Lock "cinder-1f4d1e1e-a5c3-4ef6-a654-e8e3d47e0eeb-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-2fb7d8a6-be45-4cc8-88a2-297adb7f9014 req-a9640c7c-09e5-444f-abd2-830f5279b701 tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-2fb7d8a6-be45-4cc8-88a2-297adb7f9014 req-a9640c7c-09e5-444f-abd2-830f5279b701 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:36 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5bd989-c130-4ac0-9f8b-5948e237e0d8]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-2fb7d8a6-be45-4cc8-88a2-297adb7f9014 req-a9640c7c-09e5-444f-abd2-830f5279b701 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:36 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6 Jul 03 14:06:36 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:37 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-2fb7d8a6-be45-4cc8-88a2-297adb7f9014 req-a9640c7c-09e5-444f-abd2-830f5279b701 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6" returned: 0 in 0.971s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-2fb7d8a6-be45-4cc8-88a2-297adb7f9014 req-a9640c7c-09e5-444f-abd2-830f5279b701 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.004s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-2fb7d8a6-be45-4cc8-88a2-297adb7f9014 req-a9640c7c-09e5-444f-abd2-830f5279b701 tempest-TestInstancesWithCinderVolumes-788149672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a243699-da75-4045-8eae-ad296c21096d', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:06:37 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-2fb7d8a6-be45-4cc8-88a2-297adb7f9014 req-a9640c7c-09e5-444f-abd2-830f5279b701 tempest-TestInstancesWithCinderVolumes-788149672 None] attachment_update completed successfully. Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Flow 'volume_create_manager' (181a3c2f-14bb-446b-9fee-18aa7a87bbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca3d768-135b-4e0e-8f19-dcc26d165d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca3d768-135b-4e0e-8f19-dcc26d165d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1102015195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f71596-04bb-45fb-800b-951d344ac42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1cc5631aea4ae99315e58d98fc622c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:06:39Z,use_quota=True,user_id='1953c674a04046848c250574918e840d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba3919c-d3ef-4980-b309-a25e03051785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba3919c-d3ef-4980-b309-a25e03051785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a0c7d1-5798-4544-be9f-dfb6c899bc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.image.glance [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Creating Keystone auth plugin from conf {{(pid=86805) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Flow 'volume_create_manager' (cfda0197-f07d-4363-b3c9-8b523a4847c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05321ffe-22e6-4b04-9fba-1dad12986c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05321ffe-22e6-4b04-9fba-1dad12986c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090693703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87572407-28ba-4e71-a2e3-9f516ce574a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47d4315f3474e549146f33afb31fd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:06:39Z,use_quota=True,user_id='e618b864d7ff47cea35a62fc0237743d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5740b66-369d-43d6-ae31-08bcc89a7d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5740b66-369d-43d6-ae31-08bcc89a7d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad86666c-e325-41d3-937f-ef0a3f5d441e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad86666c-e325-41d3-937f-ef0a3f5d441e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87572407-28ba-4e71-a2e3-9f516ce574a8', 'volume_name': 'volume-87572407-28ba-4e71-a2e3-9f516ce574a8', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac47df3-6f34-476a-a519-4fdad7f5f587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac47df3-6f34-476a-a519-4fdad7f5f587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae05991-0a18-46c8-a679-2bd271e54e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:39 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Volume 87572407-28ba-4e71-a2e3-9f516ce574a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87572407-28ba-4e71-a2e3-9f516ce574a8', 'volume_size': 1} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090693703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87572407-28ba-4e71-a2e3-9f516ce574a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47d4315f3474e549146f33afb31fd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:06:39Z,use_quota=True,user_id='e618b864d7ff47cea35a62fc0237743d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Creating volume 87572407-28ba-4e71-a2e3-9f516ce574a8 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:06:39 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87572407-28ba-4e71-a2e3-9f516ce574a8 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:39 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87572407-28ba-4e71-a2e3-9f516ce574a8 1073741824 Jul 03 14:06:39 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a0c7d1-5798-4544-be9f-dfb6c899bc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '87f71596-04bb-45fb-800b-951d344ac42b', 'volume_name': 'volume-87f71596-04bb-45fb-800b-951d344ac42b', 'volume_size': 1, 'image_id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '50c6afe76f7e4b1c8c512d52058b3c26', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'created_at': datetime.datetime(2026, 7, 3, 11, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14be8f8b-de0c-4029-a83f-c66e4cebc518/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547ff6ff-8108-4906-af4a-99c3ecc02a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547ff6ff-8108-4906-af4a-99c3ecc02a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb566df-424a-42b6-880a-40107d59602e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:39 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Volume 87f71596-04bb-45fb-800b-951d344ac42b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-87f71596-04bb-45fb-800b-951d344ac42b', 'volume_size': 1, 'image_id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '50c6afe76f7e4b1c8c512d52058b3c26', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'created_at': datetime.datetime(2026, 7, 3, 11, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14be8f8b-de0c-4029-a83f-c66e4cebc518/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 14:06:39 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Trying to clone 87f71596-04bb-45fb-800b-951d344ac42b from image 14be8f8b-de0c-4029-a83f-c66e4cebc518 at location (None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}]). {{(pid=86805) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 14:06:40 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_gm_dv2yedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 14:06:40 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Image download 20.69 MB at 20.69 MB/s Jul 03 14:06:40 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3eb4b3-b337-4273-98a7-ba52ba3d376c]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_gm_dv2yedevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:40 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:06:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Flow 'volume_create_manager' (1a5e5b66-b379-4e17-a1b8-446e64b0b807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cf7bb0-3092-439b-a1e1-18ddb0fae58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cf7bb0-3092-439b-a1e1-18ddb0fae58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1773867613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e91c21b-4586-4b91-93a7-350de357b203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d14d909b24b4b6a891239d91063a430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:06:40Z,use_quota=True,user_id='b8570433ebb344ee8b62cf7b3cf98153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a10bd49-f29b-4533-9c70-ce1e5a77626b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a10bd49-f29b-4533-9c70-ce1e5a77626b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:40 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_gm_dv2yedevstack@QuobyteHD Jul 03 14:06:40 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf66222-c746-4591-b3c6-5c01c8500c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf66222-c746-4591-b3c6-5c01c8500c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e91c21b-4586-4b91-93a7-350de357b203', 'volume_name': 'volume-8e91c21b-4586-4b91-93a7-350de357b203', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13357d7d-bb12-4b73-be10-27211f70eb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13357d7d-bb12-4b73-be10-27211f70eb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d140f3-6b99-4fa4-9e66-508c98d7930f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:40 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Volume 8e91c21b-4586-4b91-93a7-350de357b203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e91c21b-4586-4b91-93a7-350de357b203', 'volume_size': 1} Jul 03 14:06:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:40 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87572407-28ba-4e71-a2e3-9f516ce574a8 1073741824" returned: 0 in 1.095s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87572407-28ba-4e71-a2e3-9f516ce574a8 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:40 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87572407-28ba-4e71-a2e3-9f516ce574a8 Jul 03 14:06:40 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:41 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_gm_dv2yedevstack@QuobyteHD" returned: 0 in 0.916s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Temporary image 14be8f8b-de0c-4029-a83f-c66e4cebc518 is fetched for user 1953c674a04046848c250574918e840d. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dd9e48-9aab-4d85-bf24-2c11bcc1d45c]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_gm_dv2yedevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:41 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_gm_dv2yedevstack@QuobyteHD Jul 03 14:06:41 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:41 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87572407-28ba-4e71-a2e3-9f516ce574a8" returned: 0 in 0.711s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.977s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1773867613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e91c21b-4586-4b91-93a7-350de357b203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d14d909b24b4b6a891239d91063a430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:06:40Z,use_quota=True,user_id='b8570433ebb344ee8b62cf7b3cf98153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Creating volume 8e91c21b-4586-4b91-93a7-350de357b203 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:06:41 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae05991-0a18-46c8-a679-2bd271e54e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87572407-28ba-4e71-a2e3-9f516ce574a8', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0172608-6281-4796-b534-457a6f565045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:41 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203 1073741824 Jul 03 14:06:41 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:41 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Volume volume-87572407-28ba-4e71-a2e3-9f516ce574a8 (87572407-28ba-4e71-a2e3-9f516ce574a8): created successfully Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0172608-6281-4796-b534-457a6f565045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Flow 'volume_create_manager' (cfda0197-f07d-4363-b3c9-8b523a4847c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:41 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-06984cb0-3542-4e90-9a74-3d1bb1cb7aa7 tempest-ProjectReaderTests-1736010817 None] Created volume successfully. Jul 03 14:06:41 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_gm_dv2yedevstack@QuobyteHD" returned: 0 in 0.756s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:42 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203 1073741824" returned: 0 in 0.917s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:42 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203 Jul 03 14:06:42 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] Acquiring lock "cinder-87572407-28ba-4e71-a2e3-9f516ce574a8-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] Lock "cinder-87572407-28ba-4e71-a2e3-9f516ce574a8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] Acquiring lock "cinder-quobyte-87572407-28ba-4e71-a2e3-9f516ce574a8" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] Lock "cinder-quobyte-87572407-28ba-4e71-a2e3-9f516ce574a8" acquired by "delete_volume" :: waited 0.015s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb06de8d-7341-40ad-aa1a-44da848b1011]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87572407-28ba-4e71-a2e3-9f516ce574a8 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:42 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87572407-28ba-4e71-a2e3-9f516ce574a8 Jul 03 14:06:42 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:42 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203" returned: 0 in 0.690s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.049s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1102015195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f71596-04bb-45fb-800b-951d344ac42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1cc5631aea4ae99315e58d98fc622c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:06:39Z,use_quota=True,user_id='1953c674a04046848c250574918e840d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Creating volume 87f71596-04bb-45fb-800b-951d344ac42b {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:06:42 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:06:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:43 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b 1073741824 Jul 03 14:06:43 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d140f3-6b99-4fa4-9e66-508c98d7930f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e91c21b-4586-4b91-93a7-350de357b203', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24f710e-3523-40ac-9889-c85b22858104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:43 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Volume volume-8e91c21b-4586-4b91-93a7-350de357b203 (8e91c21b-4586-4b91-93a7-350de357b203): created successfully Jul 03 14:06:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24f710e-3523-40ac-9889-c85b22858104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Flow 'volume_create_manager' (1a5e5b66-b379-4e17-a1b8-446e64b0b807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:43 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ce7421aa-5dbc-4749-ba88-642437ea47ec tempest-VolumesSnapshotTestJSON-1098227926 None] Created volume successfully. Jul 03 14:06:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:43 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87572407-28ba-4e71-a2e3-9f516ce574a8" returned: 0 in 0.869s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87572407-28ba-4e71-a2e3-9f516ce574a8 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:43 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87572407-28ba-4e71-a2e3-9f516ce574a8 Jul 03 14:06:43 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:43 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b 1073741824" returned: 0 in 1.015s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:44 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b Jul 03 14:06:44 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:44 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87572407-28ba-4e71-a2e3-9f516ce574a8" returned: 0 in 0.709s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] Lock "cinder-quobyte-87572407-28ba-4e71-a2e3-9f516ce574a8" released by "delete_volume" :: held 1.632s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] Created reservations ['3a4c3d53-35b1-4177-b132-3b24d5c3df2e', 'bba85e2f-3d1f-4171-8c50-a2829f97892a', '4d9f64ac-4e38-4642-bfb5-c7404a204b2d', '14402faa-c738-466f-8941-37b65e878c58'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:44 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:06:44 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:44 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b" returned: 0 in 0.662s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.150s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] Creating offline snapshot 905813ba-5d05-48e2-b83f-61fe89ef7213 of volume 8e91c21b-4586-4b91-93a7-350de357b203 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Attempting download of 14be8f8b-de0c-4029-a83f-c66e4cebc518 ((None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}])) to volume 87f71596-04bb-45fb-800b-951d344ac42b. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c10d686-c4f1-41a9-891b-769184cfaae0]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e7cbe7-3ae3-4982-b9e0-2820cfe686a0]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_xsm43fy7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:44 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203 Jul 03 14:06:44 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:44 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_xsm43fy7 Jul 03 14:06:44 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:45 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.743s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:06:45 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] Deleted volume successfully. Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b726175e-6bce-47e4-b37c-9d6db2297002 tempest-ProjectReaderTests-1736010817 None] Lock "cinder-87572407-28ba-4e71-a2e3-9f516ce574a8-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Flow 'volume_create_manager' (721ba2d6-eb6e-4b5d-b264-ee6021693a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a331e9e-02c5-43aa-b1ed-be62b1ce6fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a331e9e-02c5-43aa-b1ed-be62b1ce6fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144813256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2554486c-08a8-44ff-9da6-f0cb12270658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47d4315f3474e549146f33afb31fd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:06:45Z,use_quota=True,user_id='e618b864d7ff47cea35a62fc0237743d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e743beff-84ba-4808-a3ea-0d5a3d9ce41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e743beff-84ba-4808-a3ea-0d5a3d9ce41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d68e2a-bee7-432e-9d6d-bf568641a62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d68e2a-bee7-432e-9d6d-bf568641a62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2554486c-08a8-44ff-9da6-f0cb12270658', 'volume_name': 'volume-2554486c-08a8-44ff-9da6-f0cb12270658', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d47d861-016a-447b-b51b-db07b71bc533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d47d861-016a-447b-b51b-db07b71bc533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add8cc80-3ca0-44c4-8d1a-2bb48fc602c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:45 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Volume 2554486c-08a8-44ff-9da6-f0cb12270658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2554486c-08a8-44ff-9da6-f0cb12270658', 'volume_size': 1} Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:45 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_xsm43fy7" returned: 0 in 0.913s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_xsm43fy7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:45 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203" returned: 0 in 1.013s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:45 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213 1G Jul 03 14:06:45 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:45 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_xsm43fy7 Jul 03 14:06:45 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-5fafc033-7378-413e-8e45-e674eceb310a req-973006c6-5f36-4727-9c80-fbd6d75e60ac tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:46 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_xsm43fy7" returned: 1 in 0.764s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_xsm43fy7' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:06:46 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84c8abe-c240-4451-b00f-f530095a7bfe]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_gm_dv2yedevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:46 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_gm_dv2yedevstack@QuobyteHD Jul 03 14:06:46 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:46 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213 1G" returned: 0 in 0.859s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e91c21b-4586-4b91-93a7-350de357b203 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:46 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e91c21b-4586-4b91-93a7-350de357b203 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213 Jul 03 14:06:46 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:47 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_gm_dv2yedevstack@QuobyteHD" returned: 0 in 0.726s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:47 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] 14be8f8b-de0c-4029-a83f-c66e4cebc518 was qcow2, converting to raw {{(pid=86805) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 14:06:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_gm_dv2yedevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:47 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_gm_dv2yedevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b Jul 03 14:06:47 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:47 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e91c21b-4586-4b91-93a7-350de357b203 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213" returned: 0 in 0.662s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:47 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213 is being set with open permissions: ugo+rw Jul 03 14:06:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:47 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213 Jul 03 14:06:47 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:48 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213" returned: 0 in 0.720s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:48 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.info Jul 03 14:06:48 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:48 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.info" returned: 0 in 0.786s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:48 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.info is being set with open permissions: ugo+rw Jul 03 14:06:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:48 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.info Jul 03 14:06:48 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:49 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_gm_dv2yedevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b" returned: 0 in 1.889s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_gm_dv2yedevstack@QuobyteHD, size 112.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:06:49 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Converted 112.00 MB image at 59.24 MB/s Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:49 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b 1G Jul 03 14:06:49 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:49 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.info" returned: 0 in 0.644s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.793s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.925s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144813256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2554486c-08a8-44ff-9da6-f0cb12270658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47d4315f3474e549146f33afb31fd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:06:45Z,use_quota=True,user_id='e618b864d7ff47cea35a62fc0237743d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Creating volume 2554486c-08a8-44ff-9da6-f0cb12270658 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:06:49 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2554486c-08a8-44ff-9da6-f0cb12270658 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:49 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2554486c-08a8-44ff-9da6-f0cb12270658 1073741824 Jul 03 14:06:49 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:49 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-9076535f-47c9-4e5e-bbde-40da9c15e9a3 tempest-VolumesSnapshotTestJSON-1098227926 None] Create snapshot completed successfully Jul 03 14:06:49 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b 1G" returned: 0 in 0.739s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd2f8ce-15ab-4987-a272-244cedc78929]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-905813ba-5d05-48e2-b83f-61fe89ef7213-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:49 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-905813ba-5d05-48e2-b83f-61fe89ef7213-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:49 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b Jul 03 14:06:49 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-quobyte-8e91c21b-4586-4b91-93a7-350de357b203" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-8e91c21b-4586-4b91-93a7-350de357b203" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-quobyte-905813ba-5d05-48e2-b83f-61fe89ef7213" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-905813ba-5d05-48e2-b83f-61fe89ef7213" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] Deleting offline snapshot 905813ba-5d05-48e2-b83f-61fe89ef7213 of volume 8e91c21b-4586-4b91-93a7-350de357b203 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:06:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] snapshot_file for this snap is: volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:06:50 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb65dd4-9ec5-4959-b6d1-55b4acd397f4]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:50 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213 Jul 03 14:06:50 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:50 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2554486c-08a8-44ff-9da6-f0cb12270658 1073741824" returned: 0 in 0.860s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2554486c-08a8-44ff-9da6-f0cb12270658 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:50 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2554486c-08a8-44ff-9da6-f0cb12270658 Jul 03 14:06:50 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:50 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b" returned: 0 in 0.820s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:50 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b Jul 03 14:06:50 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:50 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213" returned: 0 in 0.825s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:50 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e91c21b-4586-4b91-93a7-350de357b203(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:06:50 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9f4c6b-489c-4962-9654-5cf62dba033b]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:51 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203 Jul 03 14:06:51 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:51 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2554486c-08a8-44ff-9da6-f0cb12270658" returned: 0 in 0.723s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-5fafc033-7378-413e-8e45-e674eceb310a req-973006c6-5f36-4727-9c80-fbd6d75e60ac tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.274s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add8cc80-3ca0-44c4-8d1a-2bb48fc602c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2554486c-08a8-44ff-9da6-f0cb12270658', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d6cb01-77a5-4875-b8fa-1d4753a184bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[54805fdd-41e8-4937-8121-cfbec4b442f4]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-5fafc033-7378-413e-8e45-e674eceb310a req-973006c6-5f36-4727-9c80-fbd6d75e60ac tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ceba7e2-b422-4980-b604-46e85782c2c1 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:51 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Volume volume-2554486c-08a8-44ff-9da6-f0cb12270658 (2554486c-08a8-44ff-9da6-f0cb12270658): created successfully Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d6cb01-77a5-4875-b8fa-1d4753a184bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Flow 'volume_create_manager' (721ba2d6-eb6e-4b5d-b264-ee6021693a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:51 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ae150faf-35ab-44f7-9e38-717ec6322392 tempest-ProjectReaderTests-1736010817 None] Created volume successfully. Jul 03 14:06:51 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ceba7e2-b422-4980-b604-46e85782c2c1 Jul 03 14:06:51 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:51 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b" returned: 1 in 0.795s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Downloaded image 14be8f8b-de0c-4029-a83f-c66e4cebc518 ((None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}])) to volume 87f71596-04bb-45fb-800b-951d344ac42b successfully. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Temporary image 14be8f8b-de0c-4029-a83f-c66e4cebc518 for user 1953c674a04046848c250574918e840d is deleted. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Marking volume 87f71596-04bb-45fb-800b-951d344ac42b as bootable. {{(pid=86805) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Copying metadata from image 14be8f8b-de0c-4029-a83f-c66e4cebc518 to 87f71596-04bb-45fb-800b-951d344ac42b. {{(pid=86805) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Creating volume glance metadata for volume 87f71596-04bb-45fb-800b-951d344ac42b backed by image 14be8f8b-de0c-4029-a83f-c66e4cebc518 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86805) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb566df-424a-42b6-880a-40107d59602e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f71596-04bb-45fb-800b-951d344ac42b', 'volume_size': 1, 'image_id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '50c6afe76f7e4b1c8c512d52058b3c26', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'created_at': datetime.datetime(2026, 7, 3, 11, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14be8f8b-de0c-4029-a83f-c66e4cebc518/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4ef53c-725a-48e7-96c9-0df25dffc57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:51 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Volume volume-87f71596-04bb-45fb-800b-951d344ac42b (87f71596-04bb-45fb-800b-951d344ac42b): created successfully Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4ef53c-725a-48e7-96c9-0df25dffc57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Flow 'volume_create_manager' (181a3c2f-14bb-446b-9fee-18aa7a87bbec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:51 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-a0e5c9b9-e182-4742-b2df-2e2ca1ccc78f tempest-VolumesImageMetadata-1661104241 None] Created volume successfully. Jul 03 14:06:51 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203" returned: 0 in 0.787s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:51 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213 Jul 03 14:06:51 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:51 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] Acquiring lock "cinder-2554486c-08a8-44ff-9da6-f0cb12270658-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:52 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-5fafc033-7378-413e-8e45-e674eceb310a req-973006c6-5f36-4727-9c80-fbd6d75e60ac tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ceba7e2-b422-4980-b604-46e85782c2c1" returned: 0 in 0.844s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-5fafc033-7378-413e-8e45-e674eceb310a req-973006c6-5f36-4727-9c80-fbd6d75e60ac tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.878s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] Lock "cinder-2554486c-08a8-44ff-9da6-f0cb12270658-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-5fafc033-7378-413e-8e45-e674eceb310a req-973006c6-5f36-4727-9c80-fbd6d75e60ac tempest-TestInstancesWithCinderVolumes-788149672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-9ceba7e2-b422-4980-b604-46e85782c2c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e4c61d2-a9ed-47fb-9c60-eb6e8b9d9c1c', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:06:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] Acquiring lock "cinder-quobyte-2554486c-08a8-44ff-9da6-f0cb12270658" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] Lock "cinder-quobyte-2554486c-08a8-44ff-9da6-f0cb12270658" acquired by "delete_volume" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:52 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1d6a75-15ad-460e-a809-058e1c5f7a67]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2554486c-08a8-44ff-9da6-f0cb12270658 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:52 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-5fafc033-7378-413e-8e45-e674eceb310a req-973006c6-5f36-4727-9c80-fbd6d75e60ac tempest-TestInstancesWithCinderVolumes-788149672 None] attachment_update completed successfully. Jul 03 14:06:52 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2554486c-08a8-44ff-9da6-f0cb12270658 Jul 03 14:06:52 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Acquiring lock "cinder-87f71596-04bb-45fb-800b-951d344ac42b-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Lock "cinder-87f71596-04bb-45fb-800b-951d344ac42b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Acquiring lock "cinder-quobyte-87f71596-04bb-45fb-800b-951d344ac42b" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Lock "cinder-quobyte-87f71596-04bb-45fb-800b-951d344ac42b" acquired by "delete_volume" :: waited 0.026s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:52 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213" returned: 0 in 0.925s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:52 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213 Jul 03 14:06:52 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:52 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b68f6e1-6c24-47fb-bdf9-f654664584ab]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:52 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b Jul 03 14:06:52 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:53 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2554486c-08a8-44ff-9da6-f0cb12270658" returned: 0 in 0.928s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2554486c-08a8-44ff-9da6-f0cb12270658 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:53 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2554486c-08a8-44ff-9da6-f0cb12270658 Jul 03 14:06:53 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:53 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203.905813ba-5d05-48e2-b83f-61fe89ef7213" returned: 0 in 0.772s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:53 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=87,cinder:SELECT=87,cinder:INSERT=28,cinder:DELETE=9 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:06:53 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=96,cinder:UPDATE=89,cinder:DELETE=7,cinder:INSERT=23 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:06:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-905813ba-5d05-48e2-b83f-61fe89ef7213" released by "_delete_snapshot" :: held 3.425s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-8e91c21b-4586-4b91-93a7-350de357b203" released by "delete_snapshot" :: held 3.454s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:53 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] Created reservations ['329d7bf0-c9ce-483f-b140-041927307364', 'abf40dd0-eecf-41f6-91f6-19b20ebb2d3d', 'e2d3f253-88ce-4f94-9410-25b55f89b595', '877178f1-f596-47ed-9dee-d80ec56a75a5'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:06:53 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b" returned: 0 in 0.903s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:53 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] Delete snapshot completed successfully. Jul 03 14:06:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0ee22982-8eb5-4b24-82c6-e8a72991c0bb tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-905813ba-5d05-48e2-b83f-61fe89ef7213-delete_snapshot" released by "delete_snapshot" :: held 3.658s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:53 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b Jul 03 14:06:53 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:53 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2554486c-08a8-44ff-9da6-f0cb12270658" returned: 0 in 0.826s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] Lock "cinder-quobyte-2554486c-08a8-44ff-9da6-f0cb12270658" released by "delete_volume" :: held 1.807s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:53 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] Created reservations ['26eb2f1e-7b42-4170-8535-9d2578498f3b', 'd5e283c0-0f44-4dea-a627-269936d3f2b4', '2d24199c-b672-4cdd-9e20-f4606b703cea', '749a6d2f-d436-456b-a06a-8556efb1eb22'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:06:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:54 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:54 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:54 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:06:54 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:54 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b" returned: 1 in 0.923s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:06:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:54 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b Jul 03 14:06:54 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:54 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.810s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:54 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:06:54 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] Deleted volume successfully. Jul 03 14:06:54 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c9598f84-3bd3-4c35-95d1-6b117d34908a tempest-ProjectReaderTests-1736010817 None] Lock "cinder-2554486c-08a8-44ff-9da6-f0cb12270658-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Flow 'volume_create_manager' (42099a26-a914-47d6-be10-49e223cec7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9287bc2-ab03-44e7-84fb-5882022fcb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9287bc2-ab03-44e7-84fb-5882022fcb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-412234699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d69b5e8-0c45-495a-9120-2ca874596efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d14d909b24b4b6a891239d91063a430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:06:55Z,use_quota=True,user_id='b8570433ebb344ee8b62cf7b3cf98153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339146e7-a31d-41ed-9499-d303a5b26a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339146e7-a31d-41ed-9499-d303a5b26a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384d8d30-9d68-4a07-8c0f-be72e9857067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384d8d30-9d68-4a07-8c0f-be72e9857067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d69b5e8-0c45-495a-9120-2ca874596efd', 'volume_name': 'volume-7d69b5e8-0c45-495a-9120-2ca874596efd', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5abe3f7-695b-40dc-89da-2b392908a6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5abe3f7-695b-40dc-89da-2b392908a6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2abe862-ee02-4ec4-8540-477958b3996e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:55 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Volume 7d69b5e8-0c45-495a-9120-2ca874596efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d69b5e8-0c45-495a-9120-2ca874596efd', 'volume_size': 1} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-412234699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d69b5e8-0c45-495a-9120-2ca874596efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d14d909b24b4b6a891239d91063a430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:06:55Z,use_quota=True,user_id='b8570433ebb344ee8b62cf7b3cf98153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Creating volume 7d69b5e8-0c45-495a-9120-2ca874596efd {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:06:55 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:55 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd 1073741824 Jul 03 14:06:55 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:55 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-87f71596-04bb-45fb-800b-951d344ac42b" returned: 0 in 0.917s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Lock "cinder-quobyte-87f71596-04bb-45fb-800b-951d344ac42b" released by "delete_volume" :: held 2.836s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Created reservations ['6e291b04-3e38-4352-b3f7-6c90e64b57cf', '6d7d61ac-677f-4c4b-b70d-0f2be32029fa', '51b47621-ba10-4766-8404-5f2a180c08c4', '8e38ba58-c09a-4f5c-a7fa-86dd2a9e0833'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:55 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:06:55 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:56 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd 1073741824" returned: 0 in 1.077s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:56 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd Jul 03 14:06:56 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:56 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.053s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:56 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:06:56 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Deleted volume successfully. Jul 03 14:06:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3afe43d4-fc69-47f9-ae37-b4c0f15851e6 tempest-VolumesImageMetadata-1661104241 None] Lock "cinder-87f71596-04bb-45fb-800b-951d344ac42b-delete_volume" released by "delete_volume" :: held 4.311s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:57 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd" returned: 0 in 1.011s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:57 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] <== create_volume: return (2161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:06:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2abe862-ee02-4ec4-8540-477958b3996e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d69b5e8-0c45-495a-9120-2ca874596efd', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27963496-f30b-4748-8efd-f12ac9deadf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:57 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Volume volume-7d69b5e8-0c45-495a-9120-2ca874596efd (7d69b5e8-0c45-495a-9120-2ca874596efd): created successfully Jul 03 14:06:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27963496-f30b-4748-8efd-f12ac9deadf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Flow 'volume_create_manager' (42099a26-a914-47d6-be10-49e223cec7cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:57 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-5e6762b6-cfd0-403b-8f3c-ac104025e21c tempest-VolumesSnapshotTestJSON-1098227926 None] Created volume successfully. Jul 03 14:06:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:06:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:58 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:06:58 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] Creating offline snapshot 87400183-b6fd-4edb-a60a-8e36be325c42 of volume 7d69b5e8-0c45-495a-9120-2ca874596efd {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:06:58 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfd3ea5-2d5a-4aca-ac99-8d268c152810]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:58 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd Jul 03 14:06:58 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:59 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.889s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:06:59 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd" returned: 0 in 1.091s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:59 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42 1G Jul 03 14:06:59 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:00 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42 1G" returned: 0 in 1.050s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d69b5e8-0c45-495a-9120-2ca874596efd -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:00 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d69b5e8-0c45-495a-9120-2ca874596efd -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42 Jul 03 14:07:00 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:01 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d69b5e8-0c45-495a-9120-2ca874596efd -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42" returned: 0 in 0.809s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:01 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42 is being set with open permissions: ugo+rw Jul 03 14:07:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:01 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42 Jul 03 14:07:01 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:01 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Flow 'volume_create_manager' (8369697a-210a-467d-b9b2-ac902205cfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d960df-f095-4bd0-8aa0-cc434901aa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d960df-f095-4bd0-8aa0-cc434901aa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1843605142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9721151-e8ff-46b3-a0b7-5305213f3cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1aa732eb0b9463ca8f715e409fe6e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:02Z,use_quota=True,user_id='3082ad5617be46939aed156d1936255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b934e5e-e6fe-4ae1-9ab2-5fccdb33f025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b934e5e-e6fe-4ae1-9ab2-5fccdb33f025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4965ead-6d77-40c4-ac84-35d5ab69b7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4965ead-6d77-40c4-ac84-35d5ab69b7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9721151-e8ff-46b3-a0b7-5305213f3cc1', 'volume_name': 'volume-f9721151-e8ff-46b3-a0b7-5305213f3cc1', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5951b0-9ebd-4290-b67c-dacf7332573a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5951b0-9ebd-4290-b67c-dacf7332573a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3ac49d-fb11-4e8e-8176-425d4860aac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:01 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Volume f9721151-e8ff-46b3-a0b7-5305213f3cc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9721151-e8ff-46b3-a0b7-5305213f3cc1', 'volume_size': 1} Jul 03 14:07:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:02 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-fc67ca90-934c-46bd-ac3a-bb7e44d7c75e req-041840f5-3819-4546-be44-da483e9b449e tempest-TestInstancesWithCinderVolumes-788149672 None] Terminate volume connection completed successfully. Jul 03 14:07:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-fc67ca90-934c-46bd-ac3a-bb7e44d7c75e req-041840f5-3819-4546-be44-da483e9b449e tempest-TestInstancesWithCinderVolumes-788149672 None] Deleting attachment 0a243699-da75-4045-8eae-ad296c21096d. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:07:02 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42" returned: 0 in 0.815s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:02 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.info Jul 03 14:07:02 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:03 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.info" returned: 0 in 0.799s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:03 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.info is being set with open permissions: ugo+rw Jul 03 14:07:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:03 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.info Jul 03 14:07:03 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:04 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.info" returned: 0 in 0.775s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.467s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.183s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1843605142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9721151-e8ff-46b3-a0b7-5305213f3cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1aa732eb0b9463ca8f715e409fe6e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:02Z,use_quota=True,user_id='3082ad5617be46939aed156d1936255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Creating volume f9721151-e8ff-46b3-a0b7-5305213f3cc1 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:04 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9721151-e8ff-46b3-a0b7-5305213f3cc1 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:04 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9721151-e8ff-46b3-a0b7-5305213f3cc1 1073741824 Jul 03 14:07:04 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:04 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-c93b12b7-0b42-438e-9286-843927cfef42 tempest-VolumesSnapshotTestJSON-1098227926 None] Create snapshot completed successfully Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "cinder-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "cinder-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "cinder-quobyte-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "cinder-quobyte-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c6d1c5-4b9c-4821-a6f0-35aef68b0990]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:04 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6 Jul 03 14:07:04 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:05 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9721151-e8ff-46b3-a0b7-5305213f3cc1 1073741824" returned: 0 in 1.138s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9721151-e8ff-46b3-a0b7-5305213f3cc1 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:05 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9721151-e8ff-46b3-a0b7-5305213f3cc1 Jul 03 14:07:05 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:05 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6" returned: 0 in 1.303s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:05 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:05 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6 Jul 03 14:07:05 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Flow 'volume_create_manager' (85e411ce-61cd-46af-af0a-de12a9a6cb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da538068-60ea-4d31-8d3c-a8aaa496c6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da538068-60ea-4d31-8d3c-a8aaa496c6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1181724151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8dedff-0af9-46b1-88f2-8e2aaae3912e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d14d909b24b4b6a891239d91063a430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=87400183-b6fd-4edb-a60a-8e36be325c42,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:06Z,use_quota=True,user_id='b8570433ebb344ee8b62cf7b3cf98153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61879c5-e5fd-4094-a316-f1b56413452c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61879c5-e5fd-4094-a316-f1b56413452c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370d9364-bcb3-4972-a95e-592f18c3cbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370d9364-bcb3-4972-a95e-592f18c3cbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b8dedff-0af9-46b1-88f2-8e2aaae3912e', 'volume_name': 'volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e', 'volume_size': 2, 'snapshot_id': '87400183-b6fd-4edb-a60a-8e36be325c42'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e82809c-fe84-4893-9440-0bbde573fa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e82809c-fe84-4893-9440-0bbde573fa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bfd0b2c-31a2-4658-81c9-a467d68f0296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:05 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Volume 2b8dedff-0af9-46b1-88f2-8e2aaae3912e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e', 'volume_size': 2, 'snapshot_id': '87400183-b6fd-4edb-a60a-8e36be325c42'} Jul 03 14:07:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:06 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9721151-e8ff-46b3-a0b7-5305213f3cc1" returned: 0 in 1.104s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] <== create_volume: return (2305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.309s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.489s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-quobyte-87400183-b6fd-4edb-a60a-8e36be325c42-2b8dedff-0af9-46b1-88f2-8e2aaae3912e" by "_create_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3ac49d-fb11-4e8e-8176-425d4860aac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9721151-e8ff-46b3-a0b7-5305213f3cc1', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9febf9e5-cc8d-4de5-90a4-fb6a38ae8e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-87400183-b6fd-4edb-a60a-8e36be325c42-2b8dedff-0af9-46b1-88f2-8e2aaae3912e" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Creating volume 2b8dedff-0af9-46b1-88f2-8e2aaae3912e from snapshot 87400183-b6fd-4edb-a60a-8e36be325c42 {{(pid=86805) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-quobyte-2b8dedff-0af9-46b1-88f2-8e2aaae3912e" by "_copy_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:06 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Volume volume-f9721151-e8ff-46b3-a0b7-5305213f3cc1 (f9721151-e8ff-46b3-a0b7-5305213f3cc1): created successfully Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9febf9e5-cc8d-4de5-90a4-fb6a38ae8e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Flow 'volume_create_manager' (8369697a-210a-467d-b9b2-ac902205cfdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-2b8dedff-0af9-46b1-88f2-8e2aaae3912e" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] snapshot: 87400183-b6fd-4edb-a60a-8e36be325c42, volume: 2b8dedff-0af9-46b1-88f2-8e2aaae3912e, {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 14:07:06 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-2a5c2800-bb1f-4865-a424-c7ccafc5e7d6 tempest-AbsoluteLimitsTests-974648653 None] Created volume successfully. Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[62204649-210f-47a2-a65f-4ee5a9ebd000]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:06 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6" returned: 0 in 0.896s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "cinder-quobyte-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6" released by "delete_volume" :: held 2.269s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:06 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42 Jul 03 14:07:06 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Flow 'volume_create_manager' (b2dc9782-5a64-4ef6-b917-840a96375a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971b1900-b239-474d-9e2e-3216d441ef80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:06 devstack cinder-volume[86805]: WARNING cinder.quota [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-767516814-1403153299 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-767516814-1403153299, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:07:06 devstack cinder-volume[86805]: WARNING cinder.quota [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-767516814-1403153299 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-767516814-1403153299, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971b1900-b239-474d-9e2e-3216d441ef80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058482181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1396d588913c450c8325e2464a684922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:07Z,use_quota=True,user_id='cf7c414d2fac4cbeb069ea8e906388d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36c76f7-383e-43cf-94a6-f4a11e8515cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36c76f7-383e-43cf-94a6-f4a11e8515cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3c87ff-e9ff-4e96-9123-0722e9839fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3c87ff-e9ff-4e96-9123-0722e9839fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5', 'volume_name': 'volume-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f830f0e-0390-4737-a8f2-3f81439b9d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f830f0e-0390-4737-a8f2-3f81439b9d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f561918c-e215-4572-9832-82c5f4fc298d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:06 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Volume 9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5', 'volume_size': 1} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Created reservations ['0f0a1acf-0a91-402a-be75-d343fe7d6159', 'c0139fa9-e12b-4116-8b3b-2991ffd68e1b', '96186b0f-474e-4bc4-a1e4-539c45318ca2', '8b4ca0fd-1334-47ee-a702-e21cee4e5db1'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:06 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:07:06 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] Acquiring lock "cinder-f9721151-e8ff-46b3-a0b7-5305213f3cc1-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] Lock "cinder-f9721151-e8ff-46b3-a0b7-5305213f3cc1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:07 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42" returned: 0 in 0.887s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d69b5e8-0c45-495a-9120-2ca874596efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:07:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] will copy from snapshot at /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 14:07:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Creating direct copy from snapshot {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 14:07:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] Acquiring lock "cinder-quobyte-f9721151-e8ff-46b3-a0b7-5305213f3cc1" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:07 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1979c5e1-c290-4d8e-9baa-9024df6c635c]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] Lock "cinder-quobyte-f9721151-e8ff-46b3-a0b7-5305213f3cc1" acquired by "delete_volume" :: waited 0.046s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:07 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bde5691-9c13-4105-a515-9222d1b2dd3a]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9721151-e8ff-46b3-a0b7-5305213f3cc1 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:07 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd Jul 03 14:07:07 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:07 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9721151-e8ff-46b3-a0b7-5305213f3cc1 Jul 03 14:07:07 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:07 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.824s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:07 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:07 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Deleted volume successfully. Jul 03 14:07:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-84e936a5-4003-488a-8c8e-94f645213501 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "cinder-9778fea1-008a-4ef8-b6c7-4be34b7ca8d6-delete_volume" released by "delete_volume" :: held 3.498s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:08 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd" returned: 0 in 0.889s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:08 devstack cinder-volume[86805]: DEBUG cinder.utils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Path /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e not found in is_blk_device check {{(pid=86805) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 14:07:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:08 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e Jul 03 14:07:08 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:08 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9721151-e8ff-46b3-a0b7-5305213f3cc1" returned: 0 in 0.940s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9721151-e8ff-46b3-a0b7-5305213f3cc1 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:08 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9721151-e8ff-46b3-a0b7-5305213f3cc1 Jul 03 14:07:08 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:09 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f9721151-e8ff-46b3-a0b7-5305213f3cc1" returned: 0 in 0.685s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] Lock "cinder-quobyte-f9721151-e8ff-46b3-a0b7-5305213f3cc1" released by "delete_volume" :: held 1.698s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:09 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] Created reservations ['ac9b1691-9456-4fab-b1c4-5997a5cdb40d', '92226577-21e0-421b-86de-147e8e0d940f', 'd8b6ad58-df3a-4672-aa45-75d62a3e4330', '204c9ec2-7281-4510-bef7-5803d6bf96d9'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:09 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:07:09 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:10 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-f3dba01d-d42d-47e6-9771-cbf581f11e02 req-4a97e9ec-9c45-47c4-bc0c-7e68116032f3 tempest-TestInstancesWithCinderVolumes-788149672 None] Terminate volume connection completed successfully. Jul 03 14:07:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-f3dba01d-d42d-47e6-9771-cbf581f11e02 req-4a97e9ec-9c45-47c4-bc0c-7e68116032f3 tempest-TestInstancesWithCinderVolumes-788149672 None] Deleting attachment 4e4c61d2-a9ed-47fb-9c60-eb6e8b9d9c1c. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:07:11 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.920s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:11 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:11 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] Deleted volume successfully. Jul 03 14:07:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67b366fd-2126-48ca-8be4-e6fad5e8d054 tempest-AbsoluteLimitsTests-974648653 None] Lock "cinder-f9721151-e8ff-46b3-a0b7-5305213f3cc1-delete_volume" released by "delete_volume" :: held 4.266s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "cinder-9ceba7e2-b422-4980-b604-46e85782c2c1-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "cinder-9ceba7e2-b422-4980-b604-46e85782c2c1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "cinder-quobyte-9ceba7e2-b422-4980-b604-46e85782c2c1" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "cinder-quobyte-9ceba7e2-b422-4980-b604-46e85782c2c1" acquired by "delete_volume" :: waited 0.044s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:12 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c7e5bc-beb2-4ad9-9675-b2310364a8d9]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ceba7e2-b422-4980-b604-46e85782c2c1 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:12 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ceba7e2-b422-4980-b604-46e85782c2c1 Jul 03 14:07:12 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:14 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ceba7e2-b422-4980-b604-46e85782c2c1" returned: 0 in 1.937s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ceba7e2-b422-4980-b604-46e85782c2c1 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:14 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ceba7e2-b422-4980-b604-46e85782c2c1 Jul 03 14:07:14 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:14 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e" returned: 0 in 6.517s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:14 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c00f779-a63c-4cda-8bc0-456b93949395]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:15 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd Jul 03 14:07:15 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:15 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9ceba7e2-b422-4980-b604-46e85782c2c1" returned: 0 in 1.000s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "cinder-quobyte-9ceba7e2-b422-4980-b604-46e85782c2c1" released by "delete_volume" :: held 3.029s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:15 devstack cinder-volume[86805]: WARNING cinder.quota [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-96978237-172222770 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-96978237-172222770, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:07:15 devstack cinder-volume[86805]: WARNING cinder.quota [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-96978237-172222770 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-96978237-172222770, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:07:15 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Created reservations ['ffcd0ca4-360b-4825-882c-7ae77e7aaca8', '12f73862-b0c4-4bd5-b5d0-df5af50e6865', '36da72b5-6dc0-4c96-b67a-a80ecac23c7a', '5ca3be6a-a92f-4307-aa41-5f4666909552'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:15 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:07:15 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:16 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd" returned: 0 in 1.376s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:16 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Image conversion details: src /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:07:16 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Converted 1024.00 MB image at 157.09 MB/s Jul 03 14:07:16 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e is being set with open permissions: ugo+rw Jul 03 14:07:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:16 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e Jul 03 14:07:16 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:16 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.975s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:16 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:16 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Deleted volume successfully. Jul 03 14:07:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4d79ea15-bc4b-4c40-b48a-4fb9a21c184b tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "cinder-9ceba7e2-b422-4980-b604-46e85782c2c1-delete_volume" released by "delete_volume" :: held 4.350s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:17 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e" returned: 0 in 0.868s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-2b8dedff-0af9-46b1-88f2-8e2aaae3912e" released by "_copy_volume_from_snapshot" :: held 10.678s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-87400183-b6fd-4edb-a60a-8e36be325c42-2b8dedff-0af9-46b1-88f2-8e2aaae3912e" released by "_create_volume_from_snapshot" :: held 10.751s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.800s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.353s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058482181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1396d588913c450c8325e2464a684922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:07Z,use_quota=True,user_id='cf7c414d2fac4cbeb069ea8e906388d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Creating volume 9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:17 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:17 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5 1073741824 Jul 03 14:07:17 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bfd0b2c-31a2-4658-81c9-a467d68f0296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e', 'volume_size': 2, 'snapshot_id': '87400183-b6fd-4edb-a60a-8e36be325c42'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c384727-0ba1-49b5-b99b-8f0f5c1d8d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:17 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Volume volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e (2b8dedff-0af9-46b1-88f2-8e2aaae3912e): created successfully Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c384727-0ba1-49b5-b99b-8f0f5c1d8d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Flow 'volume_create_manager' (85e411ce-61cd-46af-af0a-de12a9a6cb19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:17 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-fd3f4787-58e9-4a51-85b8-9ee3b4540bcb tempest-VolumesSnapshotTestJSON-1098227926 None] Created volume successfully. Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-2b8dedff-0af9-46b1-88f2-8e2aaae3912e-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Flow 'volume_create_manager' (52927dbc-d4b5-4b81-ae9f-4e2de4e02de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d1af09-4ba3-4d1d-93da-e1ad02340170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-2b8dedff-0af9-46b1-88f2-8e2aaae3912e-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d1af09-4ba3-4d1d-93da-e1ad02340170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1663571391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8b250a-b07d-453a-8f9c-0c2673c0d571,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f6a9ccfb399473fa2e8214647cb5d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:18Z,use_quota=True,user_id='e1e030677cab459ca7a4126fe0024453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ecc424-489b-4c07-8549-a913586aa893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ecc424-489b-4c07-8549-a913586aa893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78847273-6592-4906-bd2a-3a2cfec0635e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78847273-6592-4906-bd2a-3a2cfec0635e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc8b250a-b07d-453a-8f9c-0c2673c0d571', 'volume_name': 'volume-cc8b250a-b07d-453a-8f9c-0c2673c0d571', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2514bd95-4d8c-4e1f-9825-50882fc595e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2514bd95-4d8c-4e1f-9825-50882fc595e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad1024e4-3e2d-4905-a0f0-1852ee2c4adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:18 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Volume cc8b250a-b07d-453a-8f9c-0c2673c0d571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc8b250a-b07d-453a-8f9c-0c2673c0d571', 'volume_size': 1} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-quobyte-2b8dedff-0af9-46b1-88f2-8e2aaae3912e" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-2b8dedff-0af9-46b1-88f2-8e2aaae3912e" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0c780d-28a9-4144-94d9-47cd956344be]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:18 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5 1073741824" returned: 0 in 1.289s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:18 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5 Jul 03 14:07:18 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:18 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e Jul 03 14:07:18 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:19 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5" returned: 0 in 0.887s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] <== create_volume: return (2256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.259s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.056s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1663571391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8b250a-b07d-453a-8f9c-0c2673c0d571,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f6a9ccfb399473fa2e8214647cb5d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:18Z,use_quota=True,user_id='e1e030677cab459ca7a4126fe0024453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Creating volume cc8b250a-b07d-453a-8f9c-0c2673c0d571 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:19 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc8b250a-b07d-453a-8f9c-0c2673c0d571 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f561918c-e215-4572-9832-82c5f4fc298d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:19 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc8b250a-b07d-453a-8f9c-0c2673c0d571 1073741824 Jul 03 14:07:19 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee65769-c8f0-4a32-a122-1868cbd5a86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:19 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e" returned: 0 in 1.033s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:19 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Volume volume-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5 (9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5): created successfully Jul 03 14:07:19 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e Jul 03 14:07:19 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee65769-c8f0-4a32-a122-1868cbd5a86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Flow 'volume_create_manager' (b2dc9782-5a64-4ef6-b917-840a96375a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:19 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-7b8aefca-a27e-4f74-aa67-75842f91e3f2 tempest-ProjectReaderTests-494811348 None] Created volume successfully. Jul 03 14:07:20 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b8dedff-0af9-46b1-88f2-8e2aaae3912e" returned: 0 in 0.819s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-2b8dedff-0af9-46b1-88f2-8e2aaae3912e" released by "delete_volume" :: held 1.901s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] Acquiring lock "cinder-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] Lock "cinder-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] Created reservations ['2112fa84-7ea3-473f-8cfd-581307df4e49', '34e448f8-c527-460c-a193-835d5b432694', '9171494b-fdd7-4096-b424-f1a5ead40475', '24df551b-fb9c-4d52-b10d-ffdd792bf826'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] Acquiring lock "cinder-quobyte-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] Lock "cinder-quobyte-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5" acquired by "delete_volume" :: waited 0.030s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c789a7ff-a541-4c13-b02a-3cd90ea13673]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:20 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:07:20 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:20 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc8b250a-b07d-453a-8f9c-0c2673c0d571 1073741824" returned: 0 in 1.115s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-87400183-b6fd-4edb-a60a-8e36be325c42-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc8b250a-b07d-453a-8f9c-0c2673c0d571 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-87400183-b6fd-4edb-a60a-8e36be325c42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-quobyte-7d69b5e8-0c45-495a-9120-2ca874596efd" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:20 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc8b250a-b07d-453a-8f9c-0c2673c0d571 Jul 03 14:07:20 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-7d69b5e8-0c45-495a-9120-2ca874596efd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-quobyte-87400183-b6fd-4edb-a60a-8e36be325c42" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:20 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5 Jul 03 14:07:20 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-87400183-b6fd-4edb-a60a-8e36be325c42" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] Deleting offline snapshot 87400183-b6fd-4edb-a60a-8e36be325c42 of volume 7d69b5e8-0c45-495a-9120-2ca874596efd {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] snapshot_file for this snap is: volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7614cbc7-361a-4226-8326-c4d7ea999c85]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:20 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42 Jul 03 14:07:20 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:21 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-0b90ae53-ad2f-43b7-acdd-45f2a55f90d1 req-9966e3cc-af3f-45c0-88fc-0f2c31ff3651 tempest-TestInstancesWithCinderVolumes-788149672 None] Terminate volume connection completed successfully. Jul 03 14:07:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-0b90ae53-ad2f-43b7-acdd-45f2a55f90d1 req-9966e3cc-af3f-45c0-88fc-0f2c31ff3651 tempest-TestInstancesWithCinderVolumes-788149672 None] Deleting attachment b879babb-5201-4d0f-a20b-947737db6d92. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:07:21 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.838s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:21 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:21 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] Deleted volume successfully. Jul 03 14:07:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0533034e-fa21-4556-9b18-3e6c53a80302 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-2b8dedff-0af9-46b1-88f2-8e2aaae3912e-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:21 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5" returned: 0 in 0.926s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:21 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5 Jul 03 14:07:21 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:21 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc8b250a-b07d-453a-8f9c-0c2673c0d571" returned: 0 in 0.891s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:07:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad1024e4-3e2d-4905-a0f0-1852ee2c4adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc8b250a-b07d-453a-8f9c-0c2673c0d571', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2949f8d1-55fd-4fb0-afeb-80d66da31143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:21 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Volume volume-cc8b250a-b07d-453a-8f9c-0c2673c0d571 (cc8b250a-b07d-453a-8f9c-0c2673c0d571): created successfully Jul 03 14:07:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2949f8d1-55fd-4fb0-afeb-80d66da31143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Flow 'volume_create_manager' (52927dbc-d4b5-4b81-ae9f-4e2de4e02de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:21 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-1a9b994a-3717-4d28-a020-3ef66bfdecab tempest-VolumesGetTest-1724567746 None] Created volume successfully. Jul 03 14:07:21 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42" returned: 0 in 1.006s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d69b5e8-0c45-495a-9120-2ca874596efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:07:21 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c422e77-4119-4964-aeb3-f3f7661b3d9a]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:21 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd Jul 03 14:07:21 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:22 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5" returned: 0 in 0.651s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] Lock "cinder-quobyte-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5" released by "delete_volume" :: held 1.646s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:22 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] Created reservations ['c6aa8002-e3ec-462d-808f-5945de212635', '4ae4b160-3bc3-4977-ac34-9ebd44c6f223', 'b84f455e-2537-4cbc-b8f6-b1cf8838af90', '8e17f0d2-0c9f-4ec7-a4a6-1e23de941467'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:22 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:07:22 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:22 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd" returned: 0 in 0.838s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:22 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42 Jul 03 14:07:22 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:22 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.782s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:23 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] Deleted volume successfully. Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e9f54bfb-dbd0-4279-a18b-0cf5beb5a560 tempest-ProjectReaderTests-494811348 None] Lock "cinder-9eaeaac8-ebe2-4d75-a190-3a0a2a62a2c5-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Flow 'volume_create_manager' (82d30413-a74f-439f-b517-5434fa0c055f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ff7dff-2280-47a5-9295-18293010ee05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ff7dff-2280-47a5-9295-18293010ee05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878972759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435c2dbe-2fc2-4e37-8169-21ae34cd97fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1396d588913c450c8325e2464a684922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:23Z,use_quota=True,user_id='cf7c414d2fac4cbeb069ea8e906388d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61db39b1-7fb7-46fa-b0bb-5d4563073acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61db39b1-7fb7-46fa-b0bb-5d4563073acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e22c1cd8-909a-4147-8686-bad9f82b16e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:23 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e22c1cd8-909a-4147-8686-bad9f82b16e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '435c2dbe-2fc2-4e37-8169-21ae34cd97fd', 'volume_name': 'volume-435c2dbe-2fc2-4e37-8169-21ae34cd97fd', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3589830-36ba-4281-b281-0fc65193f97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3589830-36ba-4281-b281-0fc65193f97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48df1926-b9c0-4e66-805e-1a09c04f496d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:23 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Volume 435c2dbe-2fc2-4e37-8169-21ae34cd97fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-435c2dbe-2fc2-4e37-8169-21ae34cd97fd', 'volume_size': 1} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878972759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435c2dbe-2fc2-4e37-8169-21ae34cd97fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1396d588913c450c8325e2464a684922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:23Z,use_quota=True,user_id='cf7c414d2fac4cbeb069ea8e906388d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Creating volume 435c2dbe-2fc2-4e37-8169-21ae34cd97fd {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:23 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-435c2dbe-2fc2-4e37-8169-21ae34cd97fd 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42" returned: 0 in 0.975s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:23 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-435c2dbe-2fc2-4e37-8169-21ae34cd97fd 1073741824 Jul 03 14:07:23 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:23 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42 Jul 03 14:07:23 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Flow 'volume_create_manager' (31c406b2-692c-4e4d-aeeb-c24e6bb20aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1daae1ba-3147-412c-820a-45b129096d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1daae1ba-3147-412c-820a-45b129096d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1559293411',display_name='tempest-VolumesGetTest-Volume-952381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6a9ccfb399473fa2e8214647cb5d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:23Z,use_quota=True,user_id='e1e030677cab459ca7a4126fe0024453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edc0251-3a98-404b-aa2a-b977f2923686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edc0251-3a98-404b-aa2a-b977f2923686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0221227-87ef-4c70-a800-12f806cc458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0221227-87ef-4c70-a800-12f806cc458a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f', 'volume_name': 'volume-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa68dd2c-b9c0-4c90-8315-4208f3fa6654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa68dd2c-b9c0-4c90-8315-4208f3fa6654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ef91a6-7268-4167-bdbc-f49f9546c4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:23 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Volume 3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f', 'volume_size': 1} Jul 03 14:07:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:24 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd.87400183-b6fd-4edb-a60a-8e36be325c42" returned: 0 in 0.652s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-87400183-b6fd-4edb-a60a-8e36be325c42" released by "_delete_snapshot" :: held 3.617s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-7d69b5e8-0c45-495a-9120-2ca874596efd" released by "delete_snapshot" :: held 3.652s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:24 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] Created reservations ['2b8bd7be-e7c3-4aef-919e-0f5730b775c8', '5344824b-acc1-4632-bcc1-9a0848fd6c34', 'c4931384-e85e-4c8f-a245-ed0bb609c1c2', 'a27d53bf-3919-4b71-9b71-d413e1d79ae1'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:24 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] Delete snapshot completed successfully. Jul 03 14:07:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-541454df-471b-447f-ae93-7133e18d55b9 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-87400183-b6fd-4edb-a60a-8e36be325c42-delete_snapshot" released by "delete_snapshot" :: held 3.778s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:24 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-435c2dbe-2fc2-4e37-8169-21ae34cd97fd 1073741824" returned: 0 in 0.876s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-435c2dbe-2fc2-4e37-8169-21ae34cd97fd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:24 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-435c2dbe-2fc2-4e37-8169-21ae34cd97fd Jul 03 14:07:24 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "cinder-09ea9347-2b40-4219-9144-9d09b7a05828-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "cinder-09ea9347-2b40-4219-9144-9d09b7a05828-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "cinder-quobyte-09ea9347-2b40-4219-9144-9d09b7a05828" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "cinder-quobyte-09ea9347-2b40-4219-9144-9d09b7a05828" acquired by "delete_volume" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:24 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b7291c-53e2-493c-8462-dc33ee489b5a]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:25 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 Jul 03 14:07:25 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:25 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-7d69b5e8-0c45-495a-9120-2ca874596efd-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-435c2dbe-2fc2-4e37-8169-21ae34cd97fd" returned: 0 in 0.676s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.460s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1559293411',display_name='tempest-VolumesGetTest-Volume-952381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6a9ccfb399473fa2e8214647cb5d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:23Z,use_quota=True,user_id='e1e030677cab459ca7a4126fe0024453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Creating volume 3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:25 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-7d69b5e8-0c45-495a-9120-2ca874596efd-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48df1926-b9c0-4e66-805e-1a09c04f496d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-435c2dbe-2fc2-4e37-8169-21ae34cd97fd', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b349cfe0-d9e9-46dc-856b-dbda438e492f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:25 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f 1073741824 Jul 03 14:07:25 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:25 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Volume volume-435c2dbe-2fc2-4e37-8169-21ae34cd97fd (435c2dbe-2fc2-4e37-8169-21ae34cd97fd): created successfully Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b349cfe0-d9e9-46dc-856b-dbda438e492f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Flow 'volume_create_manager' (82d30413-a74f-439f-b517-5434fa0c055f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:25 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-278efc81-7710-4a9a-bad5-42255635607b tempest-ProjectReaderTests-494811348 None] Created volume successfully. Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-quobyte-7d69b5e8-0c45-495a-9120-2ca874596efd" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-7d69b5e8-0c45-495a-9120-2ca874596efd" acquired by "delete_volume" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ade2d7-e6c5-4e95-aa48-60121c3f8a54]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:25 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd Jul 03 14:07:25 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:25 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828" returned: 0 in 0.843s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:25 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 Jul 03 14:07:25 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:26 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f 1073741824" returned: 0 in 0.938s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:26 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd" returned: 0 in 0.787s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:26 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd Jul 03 14:07:26 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:26 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f Jul 03 14:07:26 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] Acquiring lock "cinder-435c2dbe-2fc2-4e37-8169-21ae34cd97fd-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] Lock "cinder-435c2dbe-2fc2-4e37-8169-21ae34cd97fd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] Acquiring lock "cinder-quobyte-435c2dbe-2fc2-4e37-8169-21ae34cd97fd" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] Lock "cinder-quobyte-435c2dbe-2fc2-4e37-8169-21ae34cd97fd" acquired by "delete_volume" :: waited 0.036s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:26 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a160f072-2b34-40f0-a7e3-2845828a317f]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-435c2dbe-2fc2-4e37-8169-21ae34cd97fd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:26 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-435c2dbe-2fc2-4e37-8169-21ae34cd97fd Jul 03 14:07:26 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:26 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828" returned: 1 in 0.928s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:07:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:26 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828 Jul 03 14:07:26 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:26 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d69b5e8-0c45-495a-9120-2ca874596efd" returned: 0 in 0.718s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-7d69b5e8-0c45-495a-9120-2ca874596efd" released by "delete_volume" :: held 1.575s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:26 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] Created reservations ['ad345144-cae2-499b-a2fb-11e3ef4eaf6a', 'a9382189-ade1-452d-94f9-230030672372', '7a4ae89a-dfc4-49b7-bfec-d6de079533b8', '41381473-1abf-4549-b6d0-71cdac6c5084'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:27 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f" returned: 0 in 0.899s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:27 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:07:27 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ef91a6-7268-4167-bdbc-f49f9546c4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095313a0-e119-4547-89ea-430247d8e3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:27 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Volume volume-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f (3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f): created successfully Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095313a0-e119-4547-89ea-430247d8e3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Flow 'volume_create_manager' (31c406b2-692c-4e4d-aeeb-c24e6bb20aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:27 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-917c1d0b-e098-42be-82e1-b7397329de7b tempest-VolumesGetTest-1724567746 None] Created volume successfully. Jul 03 14:07:27 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09ea9347-2b40-4219-9144-9d09b7a05828" returned: 0 in 0.740s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "cinder-quobyte-09ea9347-2b40-4219-9144-9d09b7a05828" released by "delete_volume" :: held 2.584s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:27 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-435c2dbe-2fc2-4e37-8169-21ae34cd97fd" returned: 0 in 1.020s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-435c2dbe-2fc2-4e37-8169-21ae34cd97fd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:27 devstack cinder-volume[86805]: WARNING cinder.quota [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-361251629-1831346403 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-361251629-1831346403, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:07:27 devstack cinder-volume[86805]: WARNING cinder.quota [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-361251629-1831346403 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-361251629-1831346403, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Created reservations ['5a67fb04-5e36-4cbc-b0db-3454824fd807', '4907bb8c-ccff-4185-96cc-8bd42d50c705', '9e382f7c-87fd-4311-a79b-41e22c7b47c2', '5bd6ff34-1859-40cc-8ac1-472e83a9bbe9'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:27 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-435c2dbe-2fc2-4e37-8169-21ae34cd97fd Jul 03 14:07:27 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] Acquiring lock "cinder-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] Lock "cinder-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] Acquiring lock "cinder-quobyte-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f" acquired by "delete_volume" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:27 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:07:27 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c713b5f4-fa85-4a26-8f7b-d6187fe54657]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:28 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.002s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] Deleted volume successfully. Jul 03 14:07:28 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f Jul 03 14:07:28 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-1d83d285-1065-4cb0-8bdf-71e6e4101acc tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-7d69b5e8-0c45-495a-9120-2ca874596efd-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Flow 'volume_create_manager' (3719d8b8-9941-4f57-9ac3-4aa0cccbb4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ebccd8-4f8e-4af7-84e5-3dc06559b683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ebccd8-4f8e-4af7-84e5-3dc06559b683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-272465010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1af369-6707-45d0-88bf-2c5ec555f9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d14d909b24b4b6a891239d91063a430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:28Z,use_quota=True,user_id='b8570433ebb344ee8b62cf7b3cf98153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ee4830-0a3b-4b48-9867-a64df3c082ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ee4830-0a3b-4b48-9867-a64df3c082ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34eccc7-472b-4b78-a7d2-ba3868e16126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34eccc7-472b-4b78-a7d2-ba3868e16126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e1af369-6707-45d0-88bf-2c5ec555f9ca', 'volume_name': 'volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc7452c-36b9-4980-bf68-ee2db697708c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc7452c-36b9-4980-bf68-ee2db697708c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (550fb467-af2f-4a2b-aba9-ffa4b55fefa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:28 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Volume 0e1af369-6707-45d0-88bf-2c5ec555f9ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca', 'volume_size': 1} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-272465010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1af369-6707-45d0-88bf-2c5ec555f9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d14d909b24b4b6a891239d91063a430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:28Z,use_quota=True,user_id='b8570433ebb344ee8b62cf7b3cf98153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Creating volume 0e1af369-6707-45d0-88bf-2c5ec555f9ca {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:28 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:28 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca 1073741824 Jul 03 14:07:28 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:28 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-435c2dbe-2fc2-4e37-8169-21ae34cd97fd" returned: 0 in 1.005s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] Lock "cinder-quobyte-435c2dbe-2fc2-4e37-8169-21ae34cd97fd" released by "delete_volume" :: held 2.086s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] Created reservations ['66d81dca-df27-4714-b542-aa42c66e597b', 'cc9adb81-ece9-45c4-9c47-f2a8c80a0e0e', '2a989b00-ee07-4817-bac3-4d5ff7d3c179', '41c394a2-6f25-41c7-892c-52feea132d82'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:28 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.991s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Deleted volume successfully. Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-35dbae04-e8df-430a-b8ba-c90a79ebfe39 tempest-TestInstancesWithCinderVolumes-788149672 None] Lock "cinder-09ea9347-2b40-4219-9144-9d09b7a05828-delete_volume" released by "delete_volume" :: held 3.964s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:28 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:07:28 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:29 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f" returned: 0 in 1.239s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:29 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f Jul 03 14:07:29 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:29 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca 1073741824" returned: 0 in 1.309s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:29 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.899s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:29 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:29 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] Deleted volume successfully. Jul 03 14:07:29 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca Jul 03 14:07:29 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f9155990-a7da-4ba7-ba27-c845a10126ea tempest-ProjectReaderTests-494811348 None] Lock "cinder-435c2dbe-2fc2-4e37-8169-21ae34cd97fd-delete_volume" released by "delete_volume" :: held 3.435s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:30 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f" returned: 0 in 0.937s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f" released by "delete_volume" :: held 2.243s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] Created reservations ['d89a211b-8f2c-49df-8de3-8b367eb93814', '1bdefca8-7b3e-427c-83cb-cfbcdd19b288', 'cf09c4a7-aafb-4045-a7b3-12c8df56f648', '1f7d04f2-aa2b-406e-8976-78dcd6fc0ab2'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:30 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:07:30 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Flow 'volume_create_manager' (4ff6e723-76ed-4795-b4c6-a2db307c1845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48aed0fe-60d1-4812-8f44-b70b40779361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48aed0fe-60d1-4812-8f44-b70b40779361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1387458545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b20452f-46bc-44fd-9e90-6803dc6a76e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1396d588913c450c8325e2464a684922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:30Z,use_quota=True,user_id='cf7c414d2fac4cbeb069ea8e906388d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12bcbf9-c912-4380-81e6-93aa61d0ca2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12bcbf9-c912-4380-81e6-93aa61d0ca2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974a8206-f80f-4211-86c3-559ea3c29184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974a8206-f80f-4211-86c3-559ea3c29184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b20452f-46bc-44fd-9e90-6803dc6a76e4', 'volume_name': 'volume-1b20452f-46bc-44fd-9e90-6803dc6a76e4', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87af5ab4-021d-44f7-a0aa-bd8f5afe6bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87af5ab4-021d-44f7-a0aa-bd8f5afe6bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05ae7ca-a9ec-414a-8ed4-e3e797134495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:30 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Volume 1b20452f-46bc-44fd-9e90-6803dc6a76e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b20452f-46bc-44fd-9e90-6803dc6a76e4', 'volume_size': 1} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:30 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca" returned: 0 in 1.007s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] <== create_volume: return (2387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.391s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.196s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1387458545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b20452f-46bc-44fd-9e90-6803dc6a76e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1396d588913c450c8325e2464a684922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:30Z,use_quota=True,user_id='cf7c414d2fac4cbeb069ea8e906388d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Creating volume 1b20452f-46bc-44fd-9e90-6803dc6a76e4 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:30 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b20452f-46bc-44fd-9e90-6803dc6a76e4 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (550fb467-af2f-4a2b-aba9-ffa4b55fefa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:30 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b20452f-46bc-44fd-9e90-6803dc6a76e4 1073741824 Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea38498-1faa-42e3-8f52-9d07d9c60fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:30 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:30 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Volume volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca (0e1af369-6707-45d0-88bf-2c5ec555f9ca): created successfully Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea38498-1faa-42e3-8f52-9d07d9c60fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Flow 'volume_create_manager' (3719d8b8-9941-4f57-9ac3-4aa0cccbb4f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:30 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-2c11fada-38e7-4428-accb-9fa82d9306d5 tempest-VolumesSnapshotTestJSON-1098227926 None] Created volume successfully. Jul 03 14:07:31 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.843s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:31 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:31 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] Deleted volume successfully. Jul 03 14:07:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-19f0de4d-c7fd-4a25-a575-eb0e2bdbd987 tempest-VolumesGetTest-1724567746 None] Lock "cinder-3b891cfc-6f5e-45fa-a136-7cbc2d9cb91f-delete_volume" released by "delete_volume" :: held 3.472s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] Acquiring lock "cinder-cc8b250a-b07d-453a-8f9c-0c2673c0d571-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] Lock "cinder-cc8b250a-b07d-453a-8f9c-0c2673c0d571-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] Acquiring lock "cinder-quobyte-cc8b250a-b07d-453a-8f9c-0c2673c0d571" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-cc8b250a-b07d-453a-8f9c-0c2673c0d571" acquired by "delete_volume" :: waited 0.023s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:31 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cc0611-027b-45c0-bf29-87491cdb75b5]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc8b250a-b07d-453a-8f9c-0c2673c0d571 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:31 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc8b250a-b07d-453a-8f9c-0c2673c0d571 Jul 03 14:07:31 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:31 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b20452f-46bc-44fd-9e90-6803dc6a76e4 1073741824" returned: 0 in 1.126s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b20452f-46bc-44fd-9e90-6803dc6a76e4 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:32 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b20452f-46bc-44fd-9e90-6803dc6a76e4 Jul 03 14:07:32 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:32 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc8b250a-b07d-453a-8f9c-0c2673c0d571" returned: 0 in 0.959s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc8b250a-b07d-453a-8f9c-0c2673c0d571 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:32 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc8b250a-b07d-453a-8f9c-0c2673c0d571 Jul 03 14:07:32 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:32 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b20452f-46bc-44fd-9e90-6803dc6a76e4" returned: 0 in 0.670s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:07:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.846s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] Creating offline snapshot 0bd80466-fad7-4042-bd03-a1c07efeb198 of volume 0e1af369-6707-45d0-88bf-2c5ec555f9ca {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:07:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05ae7ca-a9ec-414a-8ed4-e3e797134495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b20452f-46bc-44fd-9e90-6803dc6a76e4', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c179e2d-ab4f-48a0-a39d-8fa82bbe6c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:32 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[45defb62-2bb5-4b46-86cb-b1e33ef3839e]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:32 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Volume volume-1b20452f-46bc-44fd-9e90-6803dc6a76e4 (1b20452f-46bc-44fd-9e90-6803dc6a76e4): created successfully Jul 03 14:07:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c179e2d-ab4f-48a0-a39d-8fa82bbe6c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Flow 'volume_create_manager' (4ff6e723-76ed-4795-b4c6-a2db307c1845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:32 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-47aa9a52-416f-4224-b1b8-0085a2a12a19 tempest-ProjectReaderTests-494811348 None] Created volume successfully. Jul 03 14:07:32 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca Jul 03 14:07:32 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:33 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc8b250a-b07d-453a-8f9c-0c2673c0d571" returned: 0 in 0.809s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-cc8b250a-b07d-453a-8f9c-0c2673c0d571" released by "delete_volume" :: held 1.840s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:33 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] Created reservations ['27ba415f-d14b-4583-a296-996680c0a711', '78623f76-457e-49c0-a1db-2cab06a2d879', 'ec1613f0-42b0-4ddb-884f-637f6c6299f2', '0de476fb-f96d-4a8e-8014-7b448ac693de'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:33 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:07:33 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] Acquiring lock "cinder-1b20452f-46bc-44fd-9e90-6803dc6a76e4-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:33 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] Lock "cinder-1b20452f-46bc-44fd-9e90-6803dc6a76e4-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca" returned: 0 in 1.258s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:34 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198 1G Jul 03 14:07:34 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] Acquiring lock "cinder-quobyte-1b20452f-46bc-44fd-9e90-6803dc6a76e4" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] Lock "cinder-quobyte-1b20452f-46bc-44fd-9e90-6803dc6a76e4" acquired by "delete_volume" :: waited 0.037s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6835417c-35d6-4c65-be19-16aafd683f70]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b20452f-46bc-44fd-9e90-6803dc6a76e4 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:34 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.016s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:34 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b20452f-46bc-44fd-9e90-6803dc6a76e4 Jul 03 14:07:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] Deleted volume successfully. Jul 03 14:07:34 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e0efd49-c3e9-4385-9360-37d9b9fed9d6 tempest-VolumesGetTest-1724567746 None] Lock "cinder-cc8b250a-b07d-453a-8f9c-0c2673c0d571-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Flow 'volume_create_manager' (9f323e0b-102c-46ff-a6b4-1f2dbe71c837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f97ea2-f586-4a28-8720-1d34377620db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f97ea2-f586-4a28-8720-1d34377620db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1463761371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34359f9-0ce5-46b1-98df-cc96dce52130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6a9ccfb399473fa2e8214647cb5d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:34Z,use_quota=True,user_id='e1e030677cab459ca7a4126fe0024453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c38fb2-76db-47a7-a33f-806d3b642c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c38fb2-76db-47a7-a33f-806d3b642c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d345b526-21c8-4236-95fb-a1e4d07420bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d345b526-21c8-4236-95fb-a1e4d07420bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd34359f9-0ce5-46b1-98df-cc96dce52130', 'volume_name': 'volume-d34359f9-0ce5-46b1-98df-cc96dce52130', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c69bff-debe-4de3-9644-52776c39314f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c69bff-debe-4de3-9644-52776c39314f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0a9878-979d-417c-a4df-0c7db9fc1f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:34 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Volume d34359f9-0ce5-46b1-98df-cc96dce52130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d34359f9-0ce5-46b1-98df-cc96dce52130', 'volume_size': 1} Jul 03 14:07:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:35 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:35 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b20452f-46bc-44fd-9e90-6803dc6a76e4" returned: 0 in 1.010s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b20452f-46bc-44fd-9e90-6803dc6a76e4 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198 1G" returned: 0 in 1.165s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:35 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b20452f-46bc-44fd-9e90-6803dc6a76e4 Jul 03 14:07:35 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:35 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198 Jul 03 14:07:35 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:35 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-1b20452f-46bc-44fd-9e90-6803dc6a76e4" returned: 0 in 0.708s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] Lock "cinder-quobyte-1b20452f-46bc-44fd-9e90-6803dc6a76e4" released by "delete_volume" :: held 1.784s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:35 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] Created reservations ['d917c5c9-2bb7-4846-897e-935463cb1cbc', 'e9671af4-a650-4e92-b7dd-4ec79b99678b', '7b14b324-d750-4d72-8f43-a2461b10df77', '679c44b6-f241-4fb8-bb5c-7222527401dd'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:35 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198" returned: 0 in 0.825s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:35 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198 is being set with open permissions: ugo+rw Jul 03 14:07:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:35 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:35 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:35 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198 Jul 03 14:07:35 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:36 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:07:36 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:36 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.703s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:36 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:36 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] Deleted volume successfully. Jul 03 14:07:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5f95e309-2bc0-447a-9532-43cfbf55f905 tempest-ProjectReaderTests-494811348 None] Lock "cinder-1b20452f-46bc-44fd-9e90-6803dc6a76e4-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:36 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Flow 'volume_create_manager' (54b2eddc-66b3-4323-911b-789b357f22f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2f6359-8791-4a2f-a5a8-f5ddc887022b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:36 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198" returned: 0 in 0.873s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2f6359-8791-4a2f-a5a8-f5ddc887022b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-604209171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ad1a73-4c6f-41f8-bf56-95a61442a083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1396d588913c450c8325e2464a684922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:37Z,use_quota=True,user_id='cf7c414d2fac4cbeb069ea8e906388d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc53b49-4873-4d5d-85da-2dc93fa2035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc53b49-4873-4d5d-85da-2dc93fa2035d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a3cfa7-da91-4d9a-ad5b-31a0fb8f8f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a3cfa7-da91-4d9a-ad5b-31a0fb8f8f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12ad1a73-4c6f-41f8-bf56-95a61442a083', 'volume_name': 'volume-12ad1a73-4c6f-41f8-bf56-95a61442a083', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd143e9-c52f-4cdc-82d1-0eb7eba9ec08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd143e9-c52f-4cdc-82d1-0eb7eba9ec08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61249c3d-be49-4c8b-8148-7c48afc4430e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:36 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Volume 12ad1a73-4c6f-41f8-bf56-95a61442a083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12ad1a73-4c6f-41f8-bf56-95a61442a083', 'volume_size': 1} Jul 03 14:07:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:36 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.info Jul 03 14:07:36 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:37 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.info" returned: 0 in 0.677s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:37 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.info is being set with open permissions: ugo+rw Jul 03 14:07:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:37 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.info Jul 03 14:07:37 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:38 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.info" returned: 0 in 0.785s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.737s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.804s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1463761371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34359f9-0ce5-46b1-98df-cc96dce52130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6a9ccfb399473fa2e8214647cb5d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:34Z,use_quota=True,user_id='e1e030677cab459ca7a4126fe0024453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:07:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Creating volume d34359f9-0ce5-46b1-98df-cc96dce52130 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:07:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:38 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:07:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:38 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 1073741824 Jul 03 14:07:38 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:38 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-2afea023-e633-4cb4-932e-a9e0694bcd10 tempest-VolumesSnapshotTestJSON-1098227926 None] Create snapshot completed successfully Jul 03 14:07:39 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 1073741824" returned: 0 in 0.970s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:39 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 Jul 03 14:07:39 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:39 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Flow 'volume_create_manager' (90590321-5e70-4501-b7c3-531a9a5e7231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a527d1-bd6c-4e29-8b3f-9c5427ae3b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a527d1-bd6c-4e29-8b3f-9c5427ae3b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-154309002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670f7e59-554b-4afc-91f3-91dd5fb34fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d14d909b24b4b6a891239d91063a430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0bd80466-fad7-4042-bd03-a1c07efeb198,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:40Z,use_quota=True,user_id='b8570433ebb344ee8b62cf7b3cf98153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207f4df2-2ae3-41c7-993e-8d9fb5400f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207f4df2-2ae3-41c7-993e-8d9fb5400f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b3bf93-cee6-457e-8f53-ddb1020bb9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b3bf93-cee6-457e-8f53-ddb1020bb9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '670f7e59-554b-4afc-91f3-91dd5fb34fd5', 'volume_name': 'volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5', 'volume_size': 1, 'snapshot_id': '0bd80466-fad7-4042-bd03-a1c07efeb198'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eed5390-47af-4b85-8ea6-d55bb15c5277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eed5390-47af-4b85-8ea6-d55bb15c5277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f75d61-8233-43dc-bcb8-cd14fcafd9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:39 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Volume 670f7e59-554b-4afc-91f3-91dd5fb34fd5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5', 'volume_size': 1, 'snapshot_id': '0bd80466-fad7-4042-bd03-a1c07efeb198'} Jul 03 14:07:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:40 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130" returned: 0 in 0.775s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:07:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.319s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-604209171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ad1a73-4c6f-41f8-bf56-95a61442a083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1396d588913c450c8325e2464a684922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:37Z,use_quota=True,user_id='cf7c414d2fac4cbeb069ea8e906388d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:07:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Creating volume 12ad1a73-4c6f-41f8-bf56-95a61442a083 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:07:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:40 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:07:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-12ad1a73-4c6f-41f8-bf56-95a61442a083 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0a9878-979d-417c-a4df-0c7db9fc1f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d34359f9-0ce5-46b1-98df-cc96dce52130', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:40 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-12ad1a73-4c6f-41f8-bf56-95a61442a083 1073741824 Jul 03 14:07:40 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9429b9b1-0445-463c-bc50-7fa0dd21fc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:40 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Volume volume-d34359f9-0ce5-46b1-98df-cc96dce52130 (d34359f9-0ce5-46b1-98df-cc96dce52130): created successfully Jul 03 14:07:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9429b9b1-0445-463c-bc50-7fa0dd21fc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Flow 'volume_create_manager' (9f323e0b-102c-46ff-a6b4-1f2dbe71c837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:40 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e3b3ee0b-7b63-49ae-8d96-fb700032761e tempest-VolumesGetTest-1724567746 None] Created volume successfully. Jul 03 14:07:41 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-12ad1a73-4c6f-41f8-bf56-95a61442a083 1073741824" returned: 0 in 0.977s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-12ad1a73-4c6f-41f8-bf56-95a61442a083 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:41 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-12ad1a73-4c6f-41f8-bf56-95a61442a083 Jul 03 14:07:41 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Flow 'volume_create_manager' (204cd16b-049b-49f3-a59a-1a3ea2a53c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48339cf2-48cb-4b9f-ab16-dda80edaa1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48339cf2-48cb-4b9f-ab16-dda80edaa1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1882869302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b59cf51f-ae93-40e8-8fa9-e8128a1892b8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f6a9ccfb399473fa2e8214647cb5d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d34359f9-0ce5-46b1-98df-cc96dce52130,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:41Z,use_quota=True,user_id='e1e030677cab459ca7a4126fe0024453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235c9320-7f21-4aaf-8358-db04b4b8259f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235c9320-7f21-4aaf-8358-db04b4b8259f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf5fa57-ac19-4074-95ac-1ab641916462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf5fa57-ac19-4074-95ac-1ab641916462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b59cf51f-ae93-40e8-8fa9-e8128a1892b8', 'volume_name': 'volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8', 'volume_size': 1, 'source_volid': 'd34359f9-0ce5-46b1-98df-cc96dce52130', 'source_volstatus': 'available'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b76f55-e6f9-412e-b7c4-a87dbac196d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b76f55-e6f9-412e-b7c4-a87dbac196d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3988b2d3-9646-4b24-b029-03c395447e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:41 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Volume b59cf51f-ae93-40e8-8fa9-e8128a1892b8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8', 'volume_size': 1, 'source_volid': 'd34359f9-0ce5-46b1-98df-cc96dce52130', 'source_volstatus': 'available'} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:41 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-12ad1a73-4c6f-41f8-bf56-95a61442a083" returned: 0 in 0.682s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.974s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-quobyte-0bd80466-fad7-4042-bd03-a1c07efeb198-670f7e59-554b-4afc-91f3-91dd5fb34fd5" by "_create_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61249c3d-be49-4c8b-8148-7c48afc4430e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ad1a73-4c6f-41f8-bf56-95a61442a083', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b529892-d1d4-4da5-8f0e-c0658c51446c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-0bd80466-fad7-4042-bd03-a1c07efeb198-670f7e59-554b-4afc-91f3-91dd5fb34fd5" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Creating volume 670f7e59-554b-4afc-91f3-91dd5fb34fd5 from snapshot 0bd80466-fad7-4042-bd03-a1c07efeb198 {{(pid=86805) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-quobyte-670f7e59-554b-4afc-91f3-91dd5fb34fd5" by "_copy_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:41 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Volume volume-12ad1a73-4c6f-41f8-bf56-95a61442a083 (12ad1a73-4c6f-41f8-bf56-95a61442a083): created successfully Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b529892-d1d4-4da5-8f0e-c0658c51446c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:41 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Flow 'volume_create_manager' (54b2eddc-66b3-4323-911b-789b357f22f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-670f7e59-554b-4afc-91f3-91dd5fb34fd5" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] snapshot: 0bd80466-fad7-4042-bd03-a1c07efeb198, volume: 670f7e59-554b-4afc-91f3-91dd5fb34fd5, {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 14:07:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:42 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ea29d0d3-30ed-44aa-80e6-1305bb7f7ea0 tempest-ProjectReaderTests-494811348 None] Created volume successfully. Jul 03 14:07:42 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b36b7d8-6485-4d04-8e3c-6ca51a0fa0f6]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:42 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198 Jul 03 14:07:42 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:42 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198" returned: 0 in 0.829s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:07:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] will copy from snapshot at /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 14:07:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Creating direct copy from snapshot {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 14:07:42 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ff5619-2d7e-4a2d-991e-daa3130932c0]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:43 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca Jul 03 14:07:43 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] Acquiring lock "cinder-12ad1a73-4c6f-41f8-bf56-95a61442a083-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] Lock "cinder-12ad1a73-4c6f-41f8-bf56-95a61442a083-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] Acquiring lock "cinder-quobyte-12ad1a73-4c6f-41f8-bf56-95a61442a083" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] Lock "cinder-quobyte-12ad1a73-4c6f-41f8-bf56-95a61442a083" acquired by "delete_volume" :: waited 0.021s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:43 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbadc408-b753-4e8b-84e2-c7f48be36d66]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-12ad1a73-4c6f-41f8-bf56-95a61442a083 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:43 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-12ad1a73-4c6f-41f8-bf56-95a61442a083 Jul 03 14:07:43 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:43 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca" returned: 0 in 0.905s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:43 devstack cinder-volume[86805]: DEBUG cinder.utils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Path /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5 not found in is_blk_device check {{(pid=86805) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 14:07:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:43 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5 Jul 03 14:07:43 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:44 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-12ad1a73-4c6f-41f8-bf56-95a61442a083" returned: 0 in 0.811s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-12ad1a73-4c6f-41f8-bf56-95a61442a083 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:44 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-12ad1a73-4c6f-41f8-bf56-95a61442a083 Jul 03 14:07:44 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:45 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-12ad1a73-4c6f-41f8-bf56-95a61442a083" returned: 0 in 0.972s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:45 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] Lock "cinder-quobyte-12ad1a73-4c6f-41f8-bf56-95a61442a083" released by "delete_volume" :: held 1.851s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:45 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] Created reservations ['edb94396-a766-411b-9e1c-8da8ba03d566', '9269a654-6bfd-4c66-8d71-612dbcde670f', '7abc6cf9-9d35-434a-babe-1b33b7414529', '8f755547-c7d9-4a20-a3cb-b3e86c4b3f38'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:45 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:07:45 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:46 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.337s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:46 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:46 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] Deleted volume successfully. Jul 03 14:07:46 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b2c899fc-6852-48d4-9bc0-9db28dd03d66 tempest-ProjectReaderTests-494811348 None] Lock "cinder-12ad1a73-4c6f-41f8-bf56-95a61442a083-delete_volume" released by "delete_volume" :: held 3.671s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:50 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5" returned: 0 in 6.542s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:50 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[60451d2f-fb76-475e-849e-1ca9ed489988]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:50 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca Jul 03 14:07:50 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:51 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca" returned: 0 in 1.213s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:51 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Image conversion details: src /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca, size 1024.00 MB, duration 6.54 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5 {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:07:51 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Converted 1024.00 MB image at 156.49 MB/s Jul 03 14:07:51 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5 is being set with open permissions: ugo+rw Jul 03 14:07:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:51 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5 Jul 03 14:07:51 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:52 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5" returned: 0 in 0.739s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-670f7e59-554b-4afc-91f3-91dd5fb34fd5" released by "_copy_volume_from_snapshot" :: held 10.355s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-0bd80466-fad7-4042-bd03-a1c07efeb198-670f7e59-554b-4afc-91f3-91dd5fb34fd5" released by "_create_volume_from_snapshot" :: held 10.409s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.443s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 10.868s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:52 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Cloning volume d34359f9-0ce5-46b1-98df-cc96dce52130 to volume b59cf51f-ae93-40e8-8fa9-e8128a1892b8 Jul 03 14:07:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f75d61-8233-43dc-bcb8-cd14fcafd9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5', 'volume_size': 1, 'snapshot_id': '0bd80466-fad7-4042-bd03-a1c07efeb198'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80f0e43-5b85-4a98-ba22-86aebc3fb40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Creating offline snapshot 2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 of volume d34359f9-0ce5-46b1-98df-cc96dce52130 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:07:52 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Volume volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5 (670f7e59-554b-4afc-91f3-91dd5fb34fd5): created successfully Jul 03 14:07:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80f0e43-5b85-4a98-ba22-86aebc3fb40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Flow 'volume_create_manager' (90590321-5e70-4501-b7c3-531a9a5e7231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:52 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[129e36b5-b515-4249-8ae5-865e62f6178d]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:52 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-07c8ffb9-2237-4427-b85a-be1140ff9a99 tempest-VolumesSnapshotTestJSON-1098227926 None] Created volume successfully. Jul 03 14:07:52 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 Jul 03 14:07:52 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-670f7e59-554b-4afc-91f3-91dd5fb34fd5-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-670f7e59-554b-4afc-91f3-91dd5fb34fd5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:53 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=120,cinder:INSERT=35,cinder:UPDATE=167,cinder:DELETE=14 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:07:53 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=113,cinder:INSERT=42,cinder:UPDATE=153,cinder:DELETE=14 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:07:53 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130" returned: 0 in 1.066s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:53 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 1G Jul 03 14:07:53 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-quobyte-670f7e59-554b-4afc-91f3-91dd5fb34fd5" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-670f7e59-554b-4afc-91f3-91dd5fb34fd5" acquired by "delete_volume" :: waited 0.026s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:53 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4481f50e-b576-44f4-b29c-41c9854ca630]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:53 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5 Jul 03 14:07:53 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:54 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 1G" returned: 0 in 1.139s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34359f9-0ce5-46b1-98df-cc96dce52130 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:54 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34359f9-0ce5-46b1-98df-cc96dce52130 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 Jul 03 14:07:54 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:55 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5" returned: 0 in 1.422s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:55 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5 Jul 03 14:07:55 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:55 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34359f9-0ce5-46b1-98df-cc96dce52130 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919" returned: 0 in 0.870s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:55 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 is being set with open permissions: ugo+rw Jul 03 14:07:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:55 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 Jul 03 14:07:55 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:55 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-670f7e59-554b-4afc-91f3-91dd5fb34fd5" returned: 0 in 0.828s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:55 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-670f7e59-554b-4afc-91f3-91dd5fb34fd5" released by "delete_volume" :: held 2.337s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:56 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] Created reservations ['f68fdd0a-f539-4b98-b94d-036ac5eb2b1e', 'a49ef2bb-c1db-49e9-baee-f4cddfb0ebc7', '2fa02b58-3ed4-4a43-a805-bfe23970a4e5', '5edc89b0-9908-4b09-b5a7-3016202f8876'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:56 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:07:56 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:56 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919" returned: 0 in 0.794s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:56 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.info Jul 03 14:07:56 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-0bd80466-fad7-4042-bd03-a1c07efeb198-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-0bd80466-fad7-4042-bd03-a1c07efeb198-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-quobyte-0e1af369-6707-45d0-88bf-2c5ec555f9ca" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-0e1af369-6707-45d0-88bf-2c5ec555f9ca" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-quobyte-0bd80466-fad7-4042-bd03-a1c07efeb198" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-0bd80466-fad7-4042-bd03-a1c07efeb198" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:57 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] Deleting offline snapshot 0bd80466-fad7-4042-bd03-a1c07efeb198 of volume 0e1af369-6707-45d0-88bf-2c5ec555f9ca {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:07:57 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] snapshot_file for this snap is: volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:07:57 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:57 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e657c5f6-84f6-4054-b43b-6952ac83f675]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.072s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:57 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:57 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] Deleted volume successfully. Jul 03 14:07:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7243e918-f686-45ed-9e92-08bc2edef662 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-670f7e59-554b-4afc-91f3-91dd5fb34fd5-delete_volume" released by "delete_volume" :: held 3.813s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:57 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198 Jul 03 14:07:57 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:57 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.info" returned: 0 in 1.091s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:57 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.info is being set with open permissions: ugo+rw Jul 03 14:07:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:57 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.info Jul 03 14:07:57 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:58 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.info" returned: 0 in 0.910s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:58 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:07:58 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Acquiring lock "cinder-quobyte-b59cf51f-ae93-40e8-8fa9-e8128a1892b8" by "_copy_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-b59cf51f-ae93-40e8-8fa9-e8128a1892b8" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] snapshot: 2fdd3bbf-5c30-40fa-83ea-71dee6f6c919, volume: b59cf51f-ae93-40e8-8fa9-e8128a1892b8, {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:58 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198" returned: 0 in 1.290s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1d1a3e-0a00-4ba7-81cb-4d2dc53caa63]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[db492a15-2c6c-4337-8739-0c44ce27b50b]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:58 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca Jul 03 14:07:58 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:58 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 Jul 03 14:07:58 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:59 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.232s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:59 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca" returned: 0 in 1.097s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:59 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198 Jul 03 14:07:59 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:59 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919" returned: 0 in 1.343s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34359f9-0ce5-46b1-98df-cc96dce52130(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:07:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] will copy from snapshot at /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 14:07:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Creating direct copy from snapshot {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 14:07:59 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f569c935-4ed3-4933-82f7-b26eed160bb7]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:00 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 Jul 03 14:08:00 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:00 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198" returned: 0 in 1.250s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:00 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198 Jul 03 14:08:00 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:01 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130" returned: 0 in 1.155s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:01 devstack cinder-volume[86805]: DEBUG cinder.utils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Path /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8 not found in is_blk_device check {{(pid=86805) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 14:08:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:01 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8 Jul 03 14:08:01 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:01 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca.0bd80466-fad7-4042-bd03-a1c07efeb198" returned: 0 in 0.980s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:01 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-0bd80466-fad7-4042-bd03-a1c07efeb198" released by "_delete_snapshot" :: held 4.822s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:01 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-0e1af369-6707-45d0-88bf-2c5ec555f9ca" released by "delete_snapshot" :: held 4.858s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:02 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] Created reservations ['8b161767-bccb-407b-82e8-188df40be26d', '4bde8f96-8a9b-4273-868d-d9e9cfcf6ad5', '531630e4-7027-4541-81d0-228261cd1f90', 'd2ab4fe5-6e92-4cd5-bf51-f973f607056a'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:02 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] Delete snapshot completed successfully. Jul 03 14:08:02 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6d5f181c-314e-4f9c-9af6-470f83fbd6a8 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-0bd80466-fad7-4042-bd03-a1c07efeb198-delete_snapshot" released by "delete_snapshot" :: held 5.073s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:02 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-0e1af369-6707-45d0-88bf-2c5ec555f9ca-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-0e1af369-6707-45d0-88bf-2c5ec555f9ca-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-quobyte-0e1af369-6707-45d0-88bf-2c5ec555f9ca" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-0e1af369-6707-45d0-88bf-2c5ec555f9ca" acquired by "delete_volume" :: waited 0.110s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:03 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce2ff2c-ac71-4ff6-8d70-6fdd62b588e5]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:03 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca Jul 03 14:08:03 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:05 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca" returned: 0 in 2.587s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:05 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca Jul 03 14:08:06 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:07 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0e1af369-6707-45d0-88bf-2c5ec555f9ca" returned: 0 in 2.077s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-0e1af369-6707-45d0-88bf-2c5ec555f9ca" released by "delete_volume" :: held 4.808s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:08 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8" returned: 0 in 6.962s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:08 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[232c3e00-5499-4f85-9de1-fbb5ce77e48b]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:08 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] Created reservations ['ff2056e8-a137-4858-8210-730164d6a6bf', 'f36123e2-2a4b-43dd-965f-1e702c6b4391', '6eb2bae4-480b-471e-b082-bb205980ecb9', 'cf228719-8337-48cf-85b5-7f983a3cea6a'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:08 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 Jul 03 14:08:08 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:08 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:08:08 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:09 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.868s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:09 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:09 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] Deleted volume successfully. Jul 03 14:08:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-794566aa-1ed5-4f42-8f84-bda8a4e26fd7 tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-0e1af369-6707-45d0-88bf-2c5ec555f9ca-delete_volume" released by "delete_volume" :: held 6.117s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-8e91c21b-4586-4b91-93a7-350de357b203-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-8e91c21b-4586-4b91-93a7-350de357b203-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "cinder-quobyte-8e91c21b-4586-4b91-93a7-350de357b203" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-8e91c21b-4586-4b91-93a7-350de357b203" acquired by "delete_volume" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:09 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ef8efe-c833-4db8-98b7-77fce36a1fe5]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:09 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130" returned: 0 in 1.459s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:09 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Image conversion details: src /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130, size 1024.00 MB, duration 6.96 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8 {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:08:09 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Converted 1024.00 MB image at 147.05 MB/s Jul 03 14:08:09 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8 is being set with open permissions: ugo+rw Jul 03 14:08:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:09 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8 Jul 03 14:08:09 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:09 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203 Jul 03 14:08:09 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:10 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203" returned: 0 in 1.047s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:10 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203 Jul 03 14:08:10 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:10 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8" returned: 0 in 1.119s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-b59cf51f-ae93-40e8-8fa9-e8128a1892b8" released by "_copy_volume_from_snapshot" :: held 12.177s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Acquiring lock "cinder-quobyte-2fdd3bbf-5c30-40fa-83ea-71dee6f6c919" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-2fdd3bbf-5c30-40fa-83ea-71dee6f6c919" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Deleting offline snapshot 2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 of volume d34359f9-0ce5-46b1-98df-cc96dce52130 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:08:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] snapshot_file for this snap is: volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:08:10 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5026d4e1-00dd-4459-be44-4db28289480f]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:10 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 Jul 03 14:08:10 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:11 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8e91c21b-4586-4b91-93a7-350de357b203" returned: 0 in 0.888s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-quobyte-8e91c21b-4586-4b91-93a7-350de357b203" released by "delete_volume" :: held 2.043s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:11 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] Created reservations ['f823f78d-dba7-4e53-aa8f-33de96b6159c', 'c12863ea-900b-4f9b-9f3d-ba6593842ab9', '20697253-aa36-4731-bd57-6f18d2ec79fe', 'cb64cc91-1278-459e-a45e-c606e1599add'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:11 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:08:11 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:11 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919" returned: 0 in 1.113s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34359f9-0ce5-46b1-98df-cc96dce52130(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:08:11 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74ce9d7-5468-4f0d-a7da-5fb7f3c1e9e0]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:12 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 Jul 03 14:08:12 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:12 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.820s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:12 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:12 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] Deleted volume successfully. Jul 03 14:08:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d31ceea6-4166-4ba8-838f-8e0acb116f5b tempest-VolumesSnapshotTestJSON-1098227926 None] Lock "cinder-8e91c21b-4586-4b91-93a7-350de357b203-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:12 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130" returned: 0 in 0.788s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:12 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 Jul 03 14:08:12 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:13 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919" returned: 0 in 1.026s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:13 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919 Jul 03 14:08:13 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:14 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130.2fdd3bbf-5c30-40fa-83ea-71dee6f6c919" returned: 0 in 0.753s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:14 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-2fdd3bbf-5c30-40fa-83ea-71dee6f6c919" released by "_delete_snapshot" :: held 3.819s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.190s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3988b2d3-9646-4b24-b029-03c395447e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8', 'volume_size': 1, 'source_volid': 'd34359f9-0ce5-46b1-98df-cc96dce52130', 'source_volstatus': 'available'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11084b9b-14ba-468a-a226-2e683cf4d39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:14 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Volume volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8 (b59cf51f-ae93-40e8-8fa9-e8128a1892b8): created successfully Jul 03 14:08:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11084b9b-14ba-468a-a226-2e683cf4d39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Flow 'volume_create_manager' (204cd16b-049b-49f3-a59a-1a3ea2a53c21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:14 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-51bbe65f-96b9-4b26-9ece-b1b6b9cdae24 tempest-VolumesGetTest-1724567746 None] Created volume successfully. Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Flow 'volume_create_manager' (116eb324-8eba-4bea-b424-fa2c2ac20efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f256609d-1b02-4860-bb6d-a9733a4c71fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f256609d-1b02-4860-bb6d-a9733a4c71fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-760626267',display_name='tempest-VolumesGetTest-Volume-1953588867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9790b59d-d779-4d1a-9fd9-a10325e4aae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6a9ccfb399473fa2e8214647cb5d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:16Z,use_quota=True,user_id='e1e030677cab459ca7a4126fe0024453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95091092-caf4-4774-aa02-58cb528347f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95091092-caf4-4774-aa02-58cb528347f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c6c9e5-ffc8-4184-aea8-362bb4716992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c6c9e5-ffc8-4184-aea8-362bb4716992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9790b59d-d779-4d1a-9fd9-a10325e4aae9', 'volume_name': 'volume-9790b59d-d779-4d1a-9fd9-a10325e4aae9', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad849f5-c9f6-481b-9c1b-d7dfe73522ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad849f5-c9f6-481b-9c1b-d7dfe73522ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1898629f-e605-4e5b-b778-4bb0885b7675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:16 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Volume 9790b59d-d779-4d1a-9fd9-a10325e4aae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9790b59d-d779-4d1a-9fd9-a10325e4aae9', 'volume_size': 1} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-760626267',display_name='tempest-VolumesGetTest-Volume-1953588867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9790b59d-d779-4d1a-9fd9-a10325e4aae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6a9ccfb399473fa2e8214647cb5d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:16Z,use_quota=True,user_id='e1e030677cab459ca7a4126fe0024453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Creating volume 9790b59d-d779-4d1a-9fd9-a10325e4aae9 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:16 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:08:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9790b59d-d779-4d1a-9fd9-a10325e4aae9 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:16 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9790b59d-d779-4d1a-9fd9-a10325e4aae9 1073741824 Jul 03 14:08:16 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:17 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9790b59d-d779-4d1a-9fd9-a10325e4aae9 1073741824" returned: 0 in 1.026s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9790b59d-d779-4d1a-9fd9-a10325e4aae9 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:17 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9790b59d-d779-4d1a-9fd9-a10325e4aae9 Jul 03 14:08:17 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:18 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9790b59d-d779-4d1a-9fd9-a10325e4aae9" returned: 0 in 0.861s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1898629f-e605-4e5b-b778-4bb0885b7675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9790b59d-d779-4d1a-9fd9-a10325e4aae9', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05851ff6-f3b4-46d2-bc96-0505ecb4b510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:18 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Volume volume-9790b59d-d779-4d1a-9fd9-a10325e4aae9 (9790b59d-d779-4d1a-9fd9-a10325e4aae9): created successfully Jul 03 14:08:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05851ff6-f3b4-46d2-bc96-0505ecb4b510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Flow 'volume_create_manager' (116eb324-8eba-4bea-b424-fa2c2ac20efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:18 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-1835c634-23cd-481d-92cc-d83671a3b670 tempest-VolumesGetTest-1724567746 None] Created volume successfully. Jul 03 14:08:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] Acquiring lock "cinder-9790b59d-d779-4d1a-9fd9-a10325e4aae9-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] Lock "cinder-9790b59d-d779-4d1a-9fd9-a10325e4aae9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] Acquiring lock "cinder-quobyte-9790b59d-d779-4d1a-9fd9-a10325e4aae9" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-9790b59d-d779-4d1a-9fd9-a10325e4aae9" acquired by "delete_volume" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:19 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34797b9-4dc9-464a-b434-5ab4d4cc865a]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9790b59d-d779-4d1a-9fd9-a10325e4aae9 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:19 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9790b59d-d779-4d1a-9fd9-a10325e4aae9 Jul 03 14:08:19 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:20 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9790b59d-d779-4d1a-9fd9-a10325e4aae9" returned: 0 in 0.950s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9790b59d-d779-4d1a-9fd9-a10325e4aae9 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:20 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9790b59d-d779-4d1a-9fd9-a10325e4aae9 Jul 03 14:08:20 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:21 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9790b59d-d779-4d1a-9fd9-a10325e4aae9" returned: 0 in 0.747s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-9790b59d-d779-4d1a-9fd9-a10325e4aae9" released by "delete_volume" :: held 1.759s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:21 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] Created reservations ['bb300edf-f379-4bc3-91cb-03bbecc4be9b', '3eb7a6d8-2fb7-4de5-9bb9-279495f03c89', '17775220-5c4b-4c1e-bdb5-5b15461fd0c7', '0cb248ec-cb2a-4543-a089-c592f22383a8'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:21 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:08:21 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] Acquiring lock "cinder-b59cf51f-ae93-40e8-8fa9-e8128a1892b8-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] Lock "cinder-b59cf51f-ae93-40e8-8fa9-e8128a1892b8-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] Acquiring lock "cinder-quobyte-b59cf51f-ae93-40e8-8fa9-e8128a1892b8" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-b59cf51f-ae93-40e8-8fa9-e8128a1892b8" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:22 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9685ca-1b8a-473b-9b1c-d369ad5af647]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:22 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8 Jul 03 14:08:22 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:22 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.915s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:22 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:22 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] Deleted volume successfully. Jul 03 14:08:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d0beae77-a891-4859-a89f-2312351cba61 tempest-VolumesGetTest-1724567746 None] Lock "cinder-9790b59d-d779-4d1a-9fd9-a10325e4aae9-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:23 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8" returned: 0 in 0.986s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:23 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8 Jul 03 14:08:23 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:24 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b59cf51f-ae93-40e8-8fa9-e8128a1892b8" returned: 0 in 0.951s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-b59cf51f-ae93-40e8-8fa9-e8128a1892b8" released by "delete_volume" :: held 1.993s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] Created reservations ['7bb8586d-a532-4e1e-b62b-34611f9a704f', '284a36ed-d6dc-488b-995e-f0f7c82a2a17', '97701938-d133-4ea9-961b-1fe6e2e020ed', '5bd0f2b6-9c95-4135-960d-990507c2fb28'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:24 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:08:24 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Flow 'volume_create_manager' (77903c30-6759-494b-a723-08f5db01758f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d69faa4-f1ca-4ba7-83ac-104fcc3157cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d69faa4-f1ca-4ba7-83ac-104fcc3157cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1556808982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e6132f-988a-4b02-a835-c269a9a8ac60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55bd76643cb547cda72d94b03934cccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:24Z,use_quota=True,user_id='4b444910e79143d793616dc33bc5b310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b180bb5a-a05c-4ca1-bc6a-18ab47d7051d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b180bb5a-a05c-4ca1-bc6a-18ab47d7051d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13e95a6-504b-44ec-8ec2-e5dc9c330ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13e95a6-504b-44ec-8ec2-e5dc9c330ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7e6132f-988a-4b02-a835-c269a9a8ac60', 'volume_name': 'volume-b7e6132f-988a-4b02-a835-c269a9a8ac60', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a45195-b2b5-4e0d-80bc-d13ca1de9722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a45195-b2b5-4e0d-80bc-d13ca1de9722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c702176-36c2-45e6-bf82-8236e8ce27a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:24 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Volume b7e6132f-988a-4b02-a835-c269a9a8ac60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7e6132f-988a-4b02-a835-c269a9a8ac60', 'volume_size': 1} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1556808982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e6132f-988a-4b02-a835-c269a9a8ac60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55bd76643cb547cda72d94b03934cccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:24Z,use_quota=True,user_id='4b444910e79143d793616dc33bc5b310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Creating volume b7e6132f-988a-4b02-a835-c269a9a8ac60 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:24 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:08:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:24 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 1073741824 Jul 03 14:08:24 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:25 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.911s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:25 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:25 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] Deleted volume successfully. Jul 03 14:08:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f4d9ac1e-a039-43fc-8079-b0c3e409a34b tempest-VolumesGetTest-1724567746 None] Lock "cinder-b59cf51f-ae93-40e8-8fa9-e8128a1892b8-delete_volume" released by "delete_volume" :: held 3.245s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] Acquiring lock "cinder-d34359f9-0ce5-46b1-98df-cc96dce52130-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] Lock "cinder-d34359f9-0ce5-46b1-98df-cc96dce52130-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] Acquiring lock "cinder-quobyte-d34359f9-0ce5-46b1-98df-cc96dce52130" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-d34359f9-0ce5-46b1-98df-cc96dce52130" acquired by "delete_volume" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:25 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7353894a-bd14-4563-9232-b6d3f77f45db]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:25 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 1073741824" returned: 0 in 1.343s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:26 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 Jul 03 14:08:26 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:26 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 Jul 03 14:08:26 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:26 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60" returned: 0 in 0.830s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] <== create_volume: return (2272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.276s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c702176-36c2-45e6-bf82-8236e8ce27a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e6132f-988a-4b02-a835-c269a9a8ac60', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e5eab8-4b6e-4002-817a-db4cf9bdb21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:26 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Volume volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 (b7e6132f-988a-4b02-a835-c269a9a8ac60): created successfully Jul 03 14:08:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e5eab8-4b6e-4002-817a-db4cf9bdb21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Flow 'volume_create_manager' (77903c30-6759-494b-a723-08f5db01758f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:26 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-52586df4-e514-4207-8bda-67a79f5887af tempest-SnapshotDependencyTests-2048220919 None] Created volume successfully. Jul 03 14:08:26 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130" returned: 0 in 1.177s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:27 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130 Jul 03 14:08:27 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Flow 'volume_create_manager' (f9e1bb2d-8181-4c49-a516-af704a77d567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6931828b-9d6e-4d4c-9ff3-d3f8cf408105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6931828b-9d6e-4d4c-9ff3-d3f8cf408105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-510795666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d2431b-1c23-4f6d-831b-fbcc74957387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eee70c18a22b40b09c42d891f2f4796e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:27Z,use_quota=True,user_id='9d45f5010b1e465fbb8770682b2968f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ef4747-6033-4848-be3a-84cf4832250b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ef4747-6033-4848-be3a-84cf4832250b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abd4c65-c6e7-4309-b761-c4e866957c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abd4c65-c6e7-4309-b761-c4e866957c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d2431b-1c23-4f6d-831b-fbcc74957387', 'volume_name': 'volume-b4d2431b-1c23-4f6d-831b-fbcc74957387', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0cb49d-0110-4998-a94e-3a54b2b2921f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0cb49d-0110-4998-a94e-3a54b2b2921f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7775ae9b-96ef-4e76-bec3-c63f89fb2a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:27 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Volume b4d2431b-1c23-4f6d-831b-fbcc74957387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d2431b-1c23-4f6d-831b-fbcc74957387', 'volume_size': 1} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-510795666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d2431b-1c23-4f6d-831b-fbcc74957387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eee70c18a22b40b09c42d891f2f4796e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:27Z,use_quota=True,user_id='9d45f5010b1e465fbb8770682b2968f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Creating volume b4d2431b-1c23-4f6d-831b-fbcc74957387 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:27 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:27 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387 1073741824 Jul 03 14:08:27 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:27 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d34359f9-0ce5-46b1-98df-cc96dce52130" returned: 0 in 0.754s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-d34359f9-0ce5-46b1-98df-cc96dce52130" released by "delete_volume" :: held 2.074s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] Created reservations ['a106c2c9-b059-4d7c-ba1d-74475b312162', '4945b985-126b-4a6c-b8d6-b841e33f3595', 'e4a1d8d3-2520-4989-a5f7-63363db3555e', 'c0d50049-cf1b-4dc0-8176-b1c29eae1017'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:28 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:08:28 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:28 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387 1073741824" returned: 0 in 0.980s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:28 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387 Jul 03 14:08:28 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:28 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.822s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:28 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] Deleted volume successfully. Jul 03 14:08:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4859503b-cd42-4519-8a64-13baf0c7d734 tempest-VolumesGetTest-1724567746 None] Lock "cinder-d34359f9-0ce5-46b1-98df-cc96dce52130-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:29 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387" returned: 0 in 0.826s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.458s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7775ae9b-96ef-4e76-bec3-c63f89fb2a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d2431b-1c23-4f6d-831b-fbcc74957387', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29ca9da-8c11-49d9-81d0-14ac663b6628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] Creating offline snapshot cf34a448-d787-461f-8d76-13deb1dc6f60 of volume b7e6132f-988a-4b02-a835-c269a9a8ac60 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:08:29 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Volume volume-b4d2431b-1c23-4f6d-831b-fbcc74957387 (b4d2431b-1c23-4f6d-831b-fbcc74957387): created successfully Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29ca9da-8c11-49d9-81d0-14ac663b6628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Flow 'volume_create_manager' (f9e1bb2d-8181-4c49-a516-af704a77d567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc6f9f0-dc64-4204-aced-e1fa0f99c7cd]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:29 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b1b1956d-62ef-4c7d-a7b5-da4aace066c6 tempest-VolumesSnapshotListTestJSON-1222240816 None] Created volume successfully. Jul 03 14:08:29 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 Jul 03 14:08:29 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Flow 'volume_create_manager' (acf14123-7e0c-4535-b847-01d425bc1baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a71fce8-0690-4d96-b5fb-98678f1f0c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a71fce8-0690-4d96-b5fb-98678f1f0c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-448998255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165b95ea-d7a4-485a-904c-060caebc0520,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f6a9ccfb399473fa2e8214647cb5d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:30Z,use_quota=True,user_id='e1e030677cab459ca7a4126fe0024453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72dead9-ccdd-4f4a-8432-deb0a7ebea1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72dead9-ccdd-4f4a-8432-deb0a7ebea1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6c6f88-9a4b-45e2-b49e-087754f4f2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:29 devstack cinder-volume[86805]: DEBUG cinder.image.glance [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Creating Keystone auth plugin from conf {{(pid=86805) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 14:08:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6c6f88-9a4b-45e2-b49e-087754f4f2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '165b95ea-d7a4-485a-904c-060caebc0520', 'volume_name': 'volume-165b95ea-d7a4-485a-904c-060caebc0520', 'volume_size': 1, 'image_id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '50c6afe76f7e4b1c8c512d52058b3c26', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'created_at': datetime.datetime(2026, 7, 3, 11, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14be8f8b-de0c-4029-a83f-c66e4cebc518/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e02725e-8f85-4460-9e1a-1bf466a46b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e02725e-8f85-4460-9e1a-1bf466a46b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718d5c6f-d058-42ac-89f5-de4304a669b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:30 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Volume 165b95ea-d7a4-485a-904c-060caebc0520: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-165b95ea-d7a4-485a-904c-060caebc0520', 'volume_size': 1, 'image_id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '50c6afe76f7e4b1c8c512d52058b3c26', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'created_at': datetime.datetime(2026, 7, 3, 11, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14be8f8b-de0c-4029-a83f-c66e4cebc518/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 14:08:30 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Trying to clone 165b95ea-d7a4-485a-904c-060caebc0520 from image 14be8f8b-de0c-4029-a83f-c66e4cebc518 at location (None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}]). {{(pid=86805) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 14:08:30 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60" returned: 0 in 0.861s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:30 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60 1G Jul 03 14:08:30 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:30 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_cj_jjxksdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 14:08:30 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Image download 20.69 MB at 20.69 MB/s Jul 03 14:08:30 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb65bd6-ddde-4c00-b986-38dfcba533ab]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_cj_jjxksdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:30 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_cj_jjxksdevstack@QuobyteHD Jul 03 14:08:30 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:31 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60 1G" returned: 0 in 0.994s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:31 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60 Jul 03 14:08:31 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:31 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_cj_jjxksdevstack@QuobyteHD" returned: 0 in 0.839s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:31 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Temporary image 14be8f8b-de0c-4029-a83f-c66e4cebc518 is fetched for user e1e030677cab459ca7a4126fe0024453. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 14:08:31 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[db591b32-9bfc-4779-a0eb-b26795591d81]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_cj_jjxksdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:31 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_cj_jjxksdevstack@QuobyteHD Jul 03 14:08:31 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:32 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60" returned: 0 in 0.767s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:32 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60 is being set with open permissions: ugo+rw Jul 03 14:08:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:32 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60 Jul 03 14:08:32 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:32 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_cj_jjxksdevstack@QuobyteHD" returned: 0 in 0.886s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:32 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60" returned: 0 in 0.715s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:32 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.info Jul 03 14:08:32 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:33 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.info" returned: 0 in 0.708s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:33 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.info is being set with open permissions: ugo+rw Jul 03 14:08:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:33 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.info Jul 03 14:08:33 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:34 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.info" returned: 0 in 0.741s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.928s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.381s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] Creating offline snapshot 70a95c53-4489-40f8-a1de-9bf492497804 of volume b4d2431b-1c23-4f6d-831b-fbcc74957387 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:08:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-3a251044-ca3f-4b07-9f25-2bd59cb19142 tempest-SnapshotDependencyTests-2048220919 None] Create snapshot completed successfully Jul 03 14:08:34 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1521e5-54fa-48c4-a5fa-c07fcdec13d3]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:34 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387 Jul 03 14:08:34 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:35 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387" returned: 0 in 0.923s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:35 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 1G Jul 03 14:08:35 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:35 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Flow 'volume_create_manager' (f2c27ee9-6a09-4b02-bf17-175653d60736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d302579d-f73e-4724-8ade-5ebb1178639f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d302579d-f73e-4724-8ade-5ebb1178639f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf05e1b-3a2e-4776-b400-ecdb073ab590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55bd76643cb547cda72d94b03934cccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cf34a448-d787-461f-8d76-13deb1dc6f60,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:36Z,use_quota=True,user_id='4b444910e79143d793616dc33bc5b310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15cc0556-2b1b-4b3f-870e-c329b6c93bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15cc0556-2b1b-4b3f-870e-c329b6c93bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47f72d1-cf21-4c12-b723-a3cd755aef22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47f72d1-cf21-4c12-b723-a3cd755aef22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dbf05e1b-3a2e-4776-b400-ecdb073ab590', 'volume_name': 'volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590', 'volume_size': 1, 'snapshot_id': 'cf34a448-d787-461f-8d76-13deb1dc6f60'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1461d1e8-d35e-4c63-b797-5deb0c5e6bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1461d1e8-d35e-4c63-b797-5deb0c5e6bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e909f29-93df-4b23-8070-69df3603b264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:36 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Volume dbf05e1b-3a2e-4776-b400-ecdb073ab590: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590', 'volume_size': 1, 'snapshot_id': 'cf34a448-d787-461f-8d76-13deb1dc6f60'} Jul 03 14:08:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:36 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 1G" returned: 0 in 0.982s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d2431b-1c23-4f6d-831b-fbcc74957387 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:36 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d2431b-1c23-4f6d-831b-fbcc74957387 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 Jul 03 14:08:36 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:37 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d2431b-1c23-4f6d-831b-fbcc74957387 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804" returned: 0 in 0.678s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:37 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 is being set with open permissions: ugo+rw Jul 03 14:08:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:37 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 Jul 03 14:08:37 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:37 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804" returned: 0 in 0.642s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:37 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.info Jul 03 14:08:37 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:38 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.info" returned: 0 in 0.791s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:38 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.info is being set with open permissions: ugo+rw Jul 03 14:08:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:38 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.info Jul 03 14:08:38 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:39 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.info" returned: 0 in 0.714s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.831s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.634s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-448998255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165b95ea-d7a4-485a-904c-060caebc0520,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f6a9ccfb399473fa2e8214647cb5d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:30Z,use_quota=True,user_id='e1e030677cab459ca7a4126fe0024453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Creating volume 165b95ea-d7a4-485a-904c-060caebc0520 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:39 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:08:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:39 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 1073741824 Jul 03 14:08:39 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:39 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-568768e7-1306-4ba8-8271-f6a5e20c2dc7 tempest-VolumesSnapshotListTestJSON-1222240816 None] Create snapshot completed successfully Jul 03 14:08:40 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 1073741824" returned: 0 in 0.856s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:40 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 Jul 03 14:08:40 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ad908e33-280b-422b-b854-623798c58205 tempest-VolumesSnapshotListTestJSON-1222240816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:41 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520" returned: 0 in 1.159s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] <== create_volume: return (2053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.191s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Acquiring lock "cinder-quobyte-cf34a448-d787-461f-8d76-13deb1dc6f60-dbf05e1b-3a2e-4776-b400-ecdb073ab590" by "_create_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-quobyte-cf34a448-d787-461f-8d76-13deb1dc6f60-dbf05e1b-3a2e-4776-b400-ecdb073ab590" acquired by "_create_volume_from_snapshot" :: waited 0.060s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Creating volume dbf05e1b-3a2e-4776-b400-ecdb073ab590 from snapshot cf34a448-d787-461f-8d76-13deb1dc6f60 {{(pid=86805) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Acquiring lock "cinder-quobyte-dbf05e1b-3a2e-4776-b400-ecdb073ab590" by "_copy_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Attempting download of 14be8f8b-de0c-4029-a83f-c66e4cebc518 ((None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}])) to volume 165b95ea-d7a4-485a-904c-060caebc0520. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-quobyte-dbf05e1b-3a2e-4776-b400-ecdb073ab590" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] snapshot: cf34a448-d787-461f-8d76-13deb1dc6f60, volume: dbf05e1b-3a2e-4776-b400-ecdb073ab590, {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c603801-9723-4a89-bbb8-730a226cc2ab]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac650fa-2d91-4451-aa9c-36ae736af03e]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_7jycmwfs {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:41 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60 Jul 03 14:08:41 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:41 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_7jycmwfs Jul 03 14:08:41 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:42 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_7jycmwfs" returned: 0 in 0.755s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_7jycmwfs {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:42 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_7jycmwfs Jul 03 14:08:42 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:42 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60" returned: 0 in 0.915s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7e6132f-988a-4b02-a835-c269a9a8ac60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:08:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] will copy from snapshot at /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 14:08:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Creating direct copy from snapshot {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 14:08:42 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19eb089-901e-4c75-9959-4e21a07b10af]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:42 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 Jul 03 14:08:42 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:43 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_7jycmwfs" returned: 1 in 0.932s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_7jycmwfs' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:08:43 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a0b7c5-958d-4f9c-870d-98b3158bc01c]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_cj_jjxksdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:43 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_cj_jjxksdevstack@QuobyteHD Jul 03 14:08:43 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:43 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60" returned: 0 in 1.043s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:43 devstack cinder-volume[86805]: DEBUG cinder.utils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Path /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590 not found in is_blk_device check {{(pid=86805) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 14:08:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:43 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590 Jul 03 14:08:43 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:44 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_cj_jjxksdevstack@QuobyteHD" returned: 0 in 0.929s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:44 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] 14be8f8b-de0c-4029-a83f-c66e4cebc518 was qcow2, converting to raw {{(pid=86805) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 14:08:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_cj_jjxksdevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:44 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_cj_jjxksdevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 Jul 03 14:08:44 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:49 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_cj_jjxksdevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520" returned: 0 in 5.650s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:49 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_cj_jjxksdevstack@QuobyteHD, size 112.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:08:49 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Converted 112.00 MB image at 19.81 MB/s Jul 03 14:08:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:49 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 1G Jul 03 14:08:49 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:50 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590" returned: 0 in 7.441s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:50 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[039f4745-2457-4d07-a56b-aa6d66a6fbc7]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:51 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 Jul 03 14:08:51 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:51 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 1G" returned: 0 in 1.448s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:51 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22ecfc4-0bad-4447-8218-effb20a692f2]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:51 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=79,cinder:SELECT=54,cinder:INSERT=22,cinder:DELETE=7 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:08:51 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=58,cinder:INSERT=15,cinder:UPDATE=67,cinder:DELETE=5 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:08:51 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 Jul 03 14:08:51 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:51 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60" returned: 0 in 1.012s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:51 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Image conversion details: src /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60, size 1024.00 MB, duration 7.44 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590 {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:08:51 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Converted 1024.00 MB image at 137.60 MB/s Jul 03 14:08:51 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590 is being set with open permissions: ugo+rw Jul 03 14:08:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:52 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590 Jul 03 14:08:52 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:52 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520" returned: 0 in 0.853s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:52 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 Jul 03 14:08:52 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:52 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590" returned: 0 in 0.648s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-quobyte-dbf05e1b-3a2e-4776-b400-ecdb073ab590" released by "_copy_volume_from_snapshot" :: held 11.242s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-quobyte-cf34a448-d787-461f-8d76-13deb1dc6f60-dbf05e1b-3a2e-4776-b400-ecdb073ab590" released by "_create_volume_from_snapshot" :: held 11.294s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.356s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ad908e33-280b-422b-b854-623798c58205 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.901s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-ad908e33-280b-422b-b854-623798c58205 tempest-VolumesSnapshotListTestJSON-1222240816 None] Creating offline snapshot ab12fbd1-9358-4683-bd97-b9821046747f of volume b4d2431b-1c23-4f6d-831b-fbcc74957387 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:08:52 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[762c2fc6-6d95-4810-a1c8-66202abcffba]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ad908e33-280b-422b-b854-623798c58205 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e909f29-93df-4b23-8070-69df3603b264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590', 'volume_size': 1, 'snapshot_id': 'cf34a448-d787-461f-8d76-13deb1dc6f60'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8211fcc1-6e1d-4b1e-912b-edac14a8e54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:52 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Volume volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590 (dbf05e1b-3a2e-4776-b400-ecdb073ab590): created successfully Jul 03 14:08:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8211fcc1-6e1d-4b1e-912b-edac14a8e54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Flow 'volume_create_manager' (f2c27ee9-6a09-4b02-bf17-175653d60736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:52 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-08965327-67c2-45f6-a3f9-4ed8b7a9ac9d tempest-SnapshotDependencyTests-2048220919 None] Created volume successfully. Jul 03 14:08:52 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 Jul 03 14:08:52 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:53 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520" returned: 1 in 0.838s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Downloaded image 14be8f8b-de0c-4029-a83f-c66e4cebc518 ((None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}])) to volume 165b95ea-d7a4-485a-904c-060caebc0520 successfully. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Temporary image 14be8f8b-de0c-4029-a83f-c66e4cebc518 for user e1e030677cab459ca7a4126fe0024453 is deleted. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Marking volume 165b95ea-d7a4-485a-904c-060caebc0520 as bootable. {{(pid=86805) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Copying metadata from image 14be8f8b-de0c-4029-a83f-c66e4cebc518 to 165b95ea-d7a4-485a-904c-060caebc0520. {{(pid=86805) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Creating volume glance metadata for volume 165b95ea-d7a4-485a-904c-060caebc0520 backed by image 14be8f8b-de0c-4029-a83f-c66e4cebc518 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86805) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] Acquiring lock "cinder-cf34a448-d787-461f-8d76-13deb1dc6f60-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-cf34a448-d787-461f-8d76-13deb1dc6f60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] Acquiring lock "cinder-quobyte-b7e6132f-988a-4b02-a835-c269a9a8ac60" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-quobyte-b7e6132f-988a-4b02-a835-c269a9a8ac60" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] Acquiring lock "cinder-quobyte-cf34a448-d787-461f-8d76-13deb1dc6f60" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-quobyte-cf34a448-d787-461f-8d76-13deb1dc6f60" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] Deleting offline snapshot cf34a448-d787-461f-8d76-13deb1dc6f60 of volume b7e6132f-988a-4b02-a835-c269a9a8ac60 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] snapshot_file for this snap is: volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718d5c6f-d058-42ac-89f5-de4304a669b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165b95ea-d7a4-485a-904c-060caebc0520', 'volume_size': 1, 'image_id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '50c6afe76f7e4b1c8c512d52058b3c26', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'created_at': datetime.datetime(2026, 7, 3, 11, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14be8f8b-de0c-4029-a83f-c66e4cebc518/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4d94c1-ceac-425e-9525-90c0b09513fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fcef52-7c64-456d-9136-540368e24574]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:53 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Volume volume-165b95ea-d7a4-485a-904c-060caebc0520 (165b95ea-d7a4-485a-904c-060caebc0520): created successfully Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4d94c1-ceac-425e-9525-90c0b09513fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Flow 'volume_create_manager' (acf14123-7e0c-4535-b847-01d425bc1baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:53 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-74c47eb4-85e1-4650-9330-6d5f4327eef4 tempest-VolumesGetTest-1724567746 None] Created volume successfully. Jul 03 14:08:53 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60 Jul 03 14:08:53 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:53 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ad908e33-280b-422b-b854-623798c58205 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804" returned: 0 in 1.035s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-ad908e33-280b-422b-b854-623798c58205 tempest-VolumesSnapshotListTestJSON-1222240816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4d2431b-1c23-4f6d-831b-fbcc74957387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:08:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ad908e33-280b-422b-b854-623798c58205 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:53 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f 1G Jul 03 14:08:53 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:54 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60" returned: 0 in 0.835s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:54 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7e6132f-988a-4b02-a835-c269a9a8ac60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:08:54 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[043a9680-869e-40a5-b30f-e245d2a348aa]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:54 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 Jul 03 14:08:54 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:54 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ad908e33-280b-422b-b854-623798c58205 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f 1G" returned: 0 in 1.178s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ad908e33-280b-422b-b854-623798c58205 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:55 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f Jul 03 14:08:55 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:55 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Flow 'volume_create_manager' (70e89d40-833e-4fed-ae10-a7b8a79bb0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e8aa5c-937b-4141-b266-de017087f948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e8aa5c-937b-4141-b266-de017087f948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1624167062',display_name='tempest-VolumesGetTest-Volume-400008268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbfc151-db6f-4763-92b4-ad5acad4ea46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6a9ccfb399473fa2e8214647cb5d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:55Z,use_quota=True,user_id='e1e030677cab459ca7a4126fe0024453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59987755-8769-4c2c-b4fe-bf64794c99ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59987755-8769-4c2c-b4fe-bf64794c99ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96aee1ea-83ad-4276-9bb4-5a58a1d8cfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96aee1ea-83ad-4276-9bb4-5a58a1d8cfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdbfc151-db6f-4763-92b4-ad5acad4ea46', 'volume_name': 'volume-bdbfc151-db6f-4763-92b4-ad5acad4ea46', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61827be-8b5d-4423-bad9-7055b6a92181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61827be-8b5d-4423-bad9-7055b6a92181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:55 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4546564-ebf7-4cb0-8b7f-9fbc6e8f330a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:55 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Volume bdbfc151-db6f-4763-92b4-ad5acad4ea46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdbfc151-db6f-4763-92b4-ad5acad4ea46', 'volume_size': 1} Jul 03 14:08:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:55 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60" returned: 0 in 1.195s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:55 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60 Jul 03 14:08:55 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:55 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ad908e33-280b-422b-b854-623798c58205 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f" returned: 0 in 0.849s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:55 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-ad908e33-280b-422b-b854-623798c58205 tempest-VolumesSnapshotListTestJSON-1222240816 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f is being set with open permissions: ugo+rw Jul 03 14:08:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ad908e33-280b-422b-b854-623798c58205 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:55 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f Jul 03 14:08:55 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:56 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60" returned: 0 in 0.813s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:56 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60 Jul 03 14:08:56 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:56 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ad908e33-280b-422b-b854-623798c58205 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f" returned: 0 in 0.658s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ad908e33-280b-422b-b854-623798c58205 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.843s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.204s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1624167062',display_name='tempest-VolumesGetTest-Volume-400008268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbfc151-db6f-4763-92b4-ad5acad4ea46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6a9ccfb399473fa2e8214647cb5d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:55Z,use_quota=True,user_id='e1e030677cab459ca7a4126fe0024453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Creating volume bdbfc151-db6f-4763-92b4-ad5acad4ea46 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:56 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bdbfc151-db6f-4763-92b4-ad5acad4ea46 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:56 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bdbfc151-db6f-4763-92b4-ad5acad4ea46 1073741824 Jul 03 14:08:56 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ad908e33-280b-422b-b854-623798c58205 tempest-VolumesSnapshotListTestJSON-1222240816 None] Create snapshot completed successfully Jul 03 14:08:56 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:56 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60.cf34a448-d787-461f-8d76-13deb1dc6f60" returned: 0 in 0.656s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-quobyte-cf34a448-d787-461f-8d76-13deb1dc6f60" released by "_delete_snapshot" :: held 3.612s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-quobyte-b7e6132f-988a-4b02-a835-c269a9a8ac60" released by "delete_snapshot" :: held 3.656s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:56 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] Created reservations ['8f2be939-4ab2-4b4a-8f27-b25a6f41b643', '216e57bb-c4c5-44c4-9223-f0159362fc7c', '805ba40a-d144-4cd4-9cb4-c59419a52e50', '92189fb6-278a-49d8-87d7-4bd8a43b084d'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:57 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] Delete snapshot completed successfully. Jul 03 14:08:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-87ba7366-ad52-4034-b0d9-bd42a1ff74cc tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-cf34a448-d787-461f-8d76-13deb1dc6f60-delete_snapshot" released by "delete_snapshot" :: held 3.855s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-88b8fd2e-63f7-4aec-9f89-7459ce69943a tempest-VolumesSnapshotListTestJSON-1222240816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] Acquiring lock "cinder-b7e6132f-988a-4b02-a835-c269a9a8ac60-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-b7e6132f-988a-4b02-a835-c269a9a8ac60-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:57 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bdbfc151-db6f-4763-92b4-ad5acad4ea46 1073741824" returned: 0 in 0.888s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] Acquiring lock "cinder-quobyte-b7e6132f-988a-4b02-a835-c269a9a8ac60" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-quobyte-b7e6132f-988a-4b02-a835-c269a9a8ac60" acquired by "delete_volume" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bdbfc151-db6f-4763-92b4-ad5acad4ea46 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:57 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7bb339-bc82-484c-ab45-094e263f011d]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:57 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bdbfc151-db6f-4763-92b4-ad5acad4ea46 Jul 03 14:08:57 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:57 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 Jul 03 14:08:57 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:58 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bdbfc151-db6f-4763-92b4-ad5acad4ea46" returned: 0 in 0.686s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-88b8fd2e-63f7-4aec-9f89-7459ce69943a tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.003s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-88b8fd2e-63f7-4aec-9f89-7459ce69943a tempest-VolumesSnapshotListTestJSON-1222240816 None] Creating offline snapshot 70997c01-62b0-4745-b077-fbfc28123de3 of volume b4d2431b-1c23-4f6d-831b-fbcc74957387 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4546564-ebf7-4cb0-8b7f-9fbc6e8f330a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdbfc151-db6f-4763-92b4-ad5acad4ea46', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03750366-b5f7-4225-a734-15e3de357e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d94885-4b45-4190-88ea-d2dafaf2be04]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-88b8fd2e-63f7-4aec-9f89-7459ce69943a tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:58 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Volume volume-bdbfc151-db6f-4763-92b4-ad5acad4ea46 (bdbfc151-db6f-4763-92b4-ad5acad4ea46): created successfully Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03750366-b5f7-4225-a734-15e3de357e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Flow 'volume_create_manager' (70e89d40-833e-4fed-ae10-a7b8a79bb0a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:58 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-df801810-081a-4169-b731-b330d5bfd0c1 tempest-VolumesGetTest-1724567746 None] Created volume successfully. Jul 03 14:08:58 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60" returned: 0 in 0.819s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:58 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60 Jul 03 14:08:58 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:58 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:58 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:58 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:08:58 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:59 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-88b8fd2e-63f7-4aec-9f89-7459ce69943a tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f" returned: 0 in 0.815s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-88b8fd2e-63f7-4aec-9f89-7459ce69943a tempest-VolumesSnapshotListTestJSON-1222240816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4d2431b-1c23-4f6d-831b-fbcc74957387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-88b8fd2e-63f7-4aec-9f89-7459ce69943a tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:59 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b7e6132f-988a-4b02-a835-c269a9a8ac60" returned: 0 in 0.757s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:59 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3 1G Jul 03 14:08:59 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-quobyte-b7e6132f-988a-4b02-a835-c269a9a8ac60" released by "delete_volume" :: held 1.655s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:59 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.757s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] Created reservations ['650b296a-bd26-4266-87ca-c595d503d75b', 'a628d5c2-a505-4782-9631-a2f3c8d29ca2', '64c99b9a-9937-434d-a349-4b143a21e8a4', '461251ba-0ce8-44b2-b0fd-ac2841e29d26'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:59 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:08:59 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] Acquiring lock "cinder-bdbfc151-db6f-4763-92b4-ad5acad4ea46-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] Lock "cinder-bdbfc151-db6f-4763-92b4-ad5acad4ea46-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] Acquiring lock "cinder-quobyte-bdbfc151-db6f-4763-92b4-ad5acad4ea46" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-bdbfc151-db6f-4763-92b4-ad5acad4ea46" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e669f884-6d7f-49bd-a78b-cfc974082ed3]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bdbfc151-db6f-4763-92b4-ad5acad4ea46 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] Acquiring lock "cinder-dbf05e1b-3a2e-4776-b400-ecdb073ab590-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-dbf05e1b-3a2e-4776-b400-ecdb073ab590-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] Acquiring lock "cinder-quobyte-dbf05e1b-3a2e-4776-b400-ecdb073ab590" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:59 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bdbfc151-db6f-4763-92b4-ad5acad4ea46 Jul 03 14:08:59 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-quobyte-dbf05e1b-3a2e-4776-b400-ecdb073ab590" acquired by "delete_volume" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d24306-312e-44e7-a458-f7eaf150a1a9]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:59 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590 Jul 03 14:08:59 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:00 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.758s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:00 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:00 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] Deleted volume successfully. Jul 03 14:09:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-732ce76a-426b-4435-bd7e-2dff8554544f tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-b7e6132f-988a-4b02-a835-c269a9a8ac60-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:00 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-88b8fd2e-63f7-4aec-9f89-7459ce69943a tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3 1G" returned: 0 in 1.002s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-88b8fd2e-63f7-4aec-9f89-7459ce69943a tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:00 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3 Jul 03 14:09:00 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:00 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bdbfc151-db6f-4763-92b4-ad5acad4ea46" returned: 0 in 0.916s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bdbfc151-db6f-4763-92b4-ad5acad4ea46 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:00 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bdbfc151-db6f-4763-92b4-ad5acad4ea46 Jul 03 14:09:00 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:00 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590" returned: 0 in 0.932s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:00 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590 Jul 03 14:09:00 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:00 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-88b8fd2e-63f7-4aec-9f89-7459ce69943a tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3" returned: 0 in 0.833s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:00 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-88b8fd2e-63f7-4aec-9f89-7459ce69943a tempest-VolumesSnapshotListTestJSON-1222240816 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3 is being set with open permissions: ugo+rw Jul 03 14:09:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-88b8fd2e-63f7-4aec-9f89-7459ce69943a tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:00 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3 Jul 03 14:09:00 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:01 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-bdbfc151-db6f-4763-92b4-ad5acad4ea46" returned: 0 in 0.877s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-bdbfc151-db6f-4763-92b4-ad5acad4ea46" released by "delete_volume" :: held 1.851s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:01 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-dbf05e1b-3a2e-4776-b400-ecdb073ab590" returned: 0 in 0.738s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-quobyte-dbf05e1b-3a2e-4776-b400-ecdb073ab590" released by "delete_volume" :: held 1.712s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] Created reservations ['59f4387f-6e1f-48e7-b744-31dca8d76c75', '0fc42964-8266-4d21-8859-5c69dc22f1c8', '218e2269-c6cf-4d4f-829e-9c0a6e518680', '54a61f2c-9ebd-4082-b718-f6b6ef1307b1'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] Created reservations ['cf36dff6-e63d-49a3-9296-9e2844a7aa09', '098fb501-d164-4f6c-b416-9696f37d45df', '7a1c8beb-3c93-47c9-9237-ddf1b353762e', '9d4cbe32-31fb-4106-a658-c3237b9f1357'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:01 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-88b8fd2e-63f7-4aec-9f89-7459ce69943a tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3" returned: 0 in 0.788s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:01 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:09:01 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-88b8fd2e-63f7-4aec-9f89-7459ce69943a tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.561s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:01 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:09:01 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:01 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-88b8fd2e-63f7-4aec-9f89-7459ce69943a tempest-VolumesSnapshotListTestJSON-1222240816 None] Create snapshot completed successfully Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Acquiring lock "cinder-165b95ea-d7a4-485a-904c-060caebc0520-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:01 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Lock "cinder-165b95ea-d7a4-485a-904c-060caebc0520-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:02 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Acquiring lock "cinder-quobyte-165b95ea-d7a4-485a-904c-060caebc0520" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:02 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-165b95ea-d7a4-485a-904c-060caebc0520" acquired by "delete_volume" :: waited 0.035s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:02 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f1bb31-48fa-4e3d-ae0c-a585feb6a9ac]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:02 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 Jul 03 14:09:02 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:02 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.185s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:02 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:02 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] Deleted volume successfully. Jul 03 14:09:02 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a05a70c4-e693-4f11-ad6b-e568923fcaca tempest-VolumesGetTest-1724567746 None] Lock "cinder-bdbfc151-db6f-4763-92b4-ad5acad4ea46-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:03 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.359s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:03 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:03 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] Deleted volume successfully. Jul 03 14:09:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6c6cb52e-a937-44a8-b0e0-18ef817c6f0d tempest-SnapshotDependencyTests-2048220919 None] Lock "cinder-dbf05e1b-3a2e-4776-b400-ecdb073ab590-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:03 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520" returned: 0 in 1.383s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:03 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 Jul 03 14:09:03 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Acquiring lock "cinder-70997c01-62b0-4745-b077-fbfc28123de3-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-70997c01-62b0-4745-b077-fbfc28123de3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Acquiring lock "cinder-quobyte-b4d2431b-1c23-4f6d-831b-fbcc74957387" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-quobyte-b4d2431b-1c23-4f6d-831b-fbcc74957387" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Acquiring lock "cinder-quobyte-70997c01-62b0-4745-b077-fbfc28123de3" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-quobyte-70997c01-62b0-4745-b077-fbfc28123de3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:03 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Deleting offline snapshot 70997c01-62b0-4745-b077-fbfc28123de3 of volume b4d2431b-1c23-4f6d-831b-fbcc74957387 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:09:03 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] snapshot_file for this snap is: volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:09:03 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c3ee9d-6de9-4edb-a1e2-2abb54f40ec5]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:03 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3 Jul 03 14:09:03 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:04 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520" returned: 1 in 0.919s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:09:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:04 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520 Jul 03 14:09:04 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:04 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3" returned: 0 in 0.854s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4d2431b-1c23-4f6d-831b-fbcc74957387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:09:04 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[79623d84-a4b3-47f3-98bb-d402557e83f9]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:04 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f Jul 03 14:09:04 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:05 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-165b95ea-d7a4-485a-904c-060caebc0520" returned: 0 in 0.796s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:05 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Lock "cinder-quobyte-165b95ea-d7a4-485a-904c-060caebc0520" released by "delete_volume" :: held 3.197s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:05 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Created reservations ['f45ec87c-e52d-4094-bd5f-8725d4342eb6', 'be497c95-3106-417b-ac00-df4e33ee3e42', '5935537d-4241-4055-b017-4401627d9d20', '63446a1c-468c-46b9-af9a-c3dddf5f2ce6'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:05 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:09:05 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:05 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f" returned: 0 in 0.876s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4d2431b-1c23-4f6d-831b-fbcc74957387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:09:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:05 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3 Jul 03 14:09:05 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:06 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.821s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:06 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:06 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Deleted volume successfully. Jul 03 14:09:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4988bb45-34ab-41d7-be40-e55f480c0c8d tempest-VolumesGetTest-1724567746 None] Lock "cinder-165b95ea-d7a4-485a-904c-060caebc0520-delete_volume" released by "delete_volume" :: held 4.327s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:06 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3" returned: 0 in 1.039s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:06 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3 Jul 03 14:09:06 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:07 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70997c01-62b0-4745-b077-fbfc28123de3" returned: 0 in 0.795s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-quobyte-70997c01-62b0-4745-b077-fbfc28123de3" released by "_delete_snapshot" :: held 3.687s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-quobyte-b4d2431b-1c23-4f6d-831b-fbcc74957387" released by "delete_snapshot" :: held 3.713s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:07 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Created reservations ['6b6ab6fe-2a84-4cdd-a44c-6242046a3256', 'adfb3c42-04b2-4585-8cdf-a7f1c5d139b3', '5e71c38e-d93f-4174-a4cb-1eaf8e1f699f', '9b955c0b-589e-4973-92a4-ed1ee8e955cd'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:07 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Delete snapshot completed successfully. Jul 03 14:09:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9fa91f76-cee4-4a20-bdd8-365d2df4b6a0 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-70997c01-62b0-4745-b077-fbfc28123de3-delete_snapshot" released by "delete_snapshot" :: held 3.893s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Acquiring lock "cinder-ab12fbd1-9358-4683-bd97-b9821046747f-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-ab12fbd1-9358-4683-bd97-b9821046747f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Acquiring lock "cinder-quobyte-b4d2431b-1c23-4f6d-831b-fbcc74957387" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-quobyte-b4d2431b-1c23-4f6d-831b-fbcc74957387" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Acquiring lock "cinder-quobyte-ab12fbd1-9358-4683-bd97-b9821046747f" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-quobyte-ab12fbd1-9358-4683-bd97-b9821046747f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Deleting offline snapshot ab12fbd1-9358-4683-bd97-b9821046747f of volume b4d2431b-1c23-4f6d-831b-fbcc74957387 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:09:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] snapshot_file for this snap is: volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:09:08 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a0d8c6-3da0-4d01-bd65-972c5b37f3aa]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:08 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f Jul 03 14:09:08 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:09 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f" returned: 0 in 0.995s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4d2431b-1c23-4f6d-831b-fbcc74957387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a71a8b-82bd-4fde-b43a-fb8352955216]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:09 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 Jul 03 14:09:09 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Flow 'volume_create_manager' (797944ad-36bc-4e77-aa70-2d3cd655f9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbae9b7-d579-4473-892c-d0401131bd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbae9b7-d579-4473-892c-d0401131bd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-470070845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c0d7ed2356d4e95a9bd3b4978bc39d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:10Z,use_quota=True,user_id='7a810481ff7845978c1cf3daad3e6171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda404e3-80c0-4181-87fe-e44b5e3d9a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda404e3-80c0-4181-87fe-e44b5e3d9a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0e0c4f-c362-4e0b-9e01-b4a04fe4ba44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0e0c4f-c362-4e0b-9e01-b4a04fe4ba44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7', 'volume_name': 'volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a510d33c-12d7-424d-9231-46c8f307d64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a510d33c-12d7-424d-9231-46c8f307d64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fccf1c8-e67e-4c12-b32c-1fa6ec1a7f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:09 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Volume f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7', 'volume_size': 1} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-470070845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c0d7ed2356d4e95a9bd3b4978bc39d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:10Z,use_quota=True,user_id='7a810481ff7845978c1cf3daad3e6171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Creating volume f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:09 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:09:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:09 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7 1073741824 Jul 03 14:09:09 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:10 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Flow 'volume_create_manager' (44430d35-bf0d-42c1-8988-6a7d47d8840c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84953cb9-8bd3-4373-b938-fe592f2ee1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84953cb9-8bd3-4373-b938-fe592f2ee1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-639270755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38b364f-41c9-419c-9a1b-f0394d8f8833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d3538e5344b0e8b4961c0b5296139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:10Z,use_quota=True,user_id='7d6af9e22f6249a18859dbc1578c39ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a395c725-d408-4499-8bee-02c7c84e8cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a395c725-d408-4499-8bee-02c7c84e8cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f8f5a2-e94a-4973-abe2-39caa9d5bb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:10 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f8f5a2-e94a-4973-abe2-39caa9d5bb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e38b364f-41c9-419c-9a1b-f0394d8f8833', 'volume_name': 'volume-e38b364f-41c9-419c-9a1b-f0394d8f8833', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8477d6d-8dbd-4088-b088-949cf1d557c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8477d6d-8dbd-4088-b088-949cf1d557c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5c6fb1-0dc6-4782-94f9-4780df2b861f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:10 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume e38b364f-41c9-419c-9a1b-f0394d8f8833: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e38b364f-41c9-419c-9a1b-f0394d8f8833', 'volume_size': 1} Jul 03 14:09:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804" returned: 0 in 0.956s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4d2431b-1c23-4f6d-831b-fbcc74957387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:09:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:10 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f Jul 03 14:09:10 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:10 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7 1073741824" returned: 0 in 1.012s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:10 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7 Jul 03 14:09:10 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:11 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f" returned: 0 in 0.950s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:11 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f Jul 03 14:09:11 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:11 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7" returned: 0 in 0.817s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.549s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-639270755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38b364f-41c9-419c-9a1b-f0394d8f8833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d3538e5344b0e8b4961c0b5296139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:10Z,use_quota=True,user_id='7d6af9e22f6249a18859dbc1578c39ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Creating volume e38b364f-41c9-419c-9a1b-f0394d8f8833 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:11 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e38b364f-41c9-419c-9a1b-f0394d8f8833 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fccf1c8-e67e-4c12-b32c-1fa6ec1a7f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:11 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e38b364f-41c9-419c-9a1b-f0394d8f8833 1073741824 Jul 03 14:09:11 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef0c841-ff1e-42bc-a0cc-ff59fc126b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:11 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Volume volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7 (f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7): created successfully Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef0c841-ff1e-42bc-a0cc-ff59fc126b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Flow 'volume_create_manager' (797944ad-36bc-4e77-aa70-2d3cd655f9a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:11 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-66f6175e-71fc-41ec-b282-7eb71643d932 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Created volume successfully. Jul 03 14:09:11 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.ab12fbd1-9358-4683-bd97-b9821046747f" returned: 0 in 0.807s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-quobyte-ab12fbd1-9358-4683-bd97-b9821046747f" released by "_delete_snapshot" :: held 3.850s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-quobyte-b4d2431b-1c23-4f6d-831b-fbcc74957387" released by "delete_snapshot" :: held 3.896s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:12 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Created reservations ['eaf36012-700b-4c2e-b5ff-464c21cf3663', 'e32d9410-49de-4549-b6d0-131e729b4df8', '63ec9b02-fc27-47b1-8261-d400c8053d38', 'cada57e8-a9a5-4daf-b7bd-b735b02d39a3'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:12 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Delete snapshot completed successfully. Jul 03 14:09:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-bf09e2c6-ffe7-4e22-9615-f0053bbd0d13 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-ab12fbd1-9358-4683-bd97-b9821046747f-delete_snapshot" released by "delete_snapshot" :: held 4.149s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] Acquiring lock "cinder-70a95c53-4489-40f8-a1de-9bf492497804-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-70a95c53-4489-40f8-a1de-9bf492497804-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] Acquiring lock "cinder-quobyte-b4d2431b-1c23-4f6d-831b-fbcc74957387" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-quobyte-b4d2431b-1c23-4f6d-831b-fbcc74957387" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] Acquiring lock "cinder-quobyte-70a95c53-4489-40f8-a1de-9bf492497804" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-quobyte-70a95c53-4489-40f8-a1de-9bf492497804" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] Deleting offline snapshot 70a95c53-4489-40f8-a1de-9bf492497804 of volume b4d2431b-1c23-4f6d-831b-fbcc74957387 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:09:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] snapshot_file for this snap is: volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:09:12 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fc229c-d8df-46d0-85f2-6fabd30264af]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:12 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 Jul 03 14:09:12 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:12 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e38b364f-41c9-419c-9a1b-f0394d8f8833 1073741824" returned: 0 in 0.987s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e38b364f-41c9-419c-9a1b-f0394d8f8833 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:12 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e38b364f-41c9-419c-9a1b-f0394d8f8833 Jul 03 14:09:12 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:13 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804" returned: 0 in 0.943s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4d2431b-1c23-4f6d-831b-fbcc74957387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:09:13 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[41081c10-2318-4be3-b4a5-df2ffe507ff0]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:13 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387 Jul 03 14:09:13 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:13 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e38b364f-41c9-419c-9a1b-f0394d8f8833" returned: 0 in 0.817s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5c6fb1-0dc6-4782-94f9-4780df2b861f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e38b364f-41c9-419c-9a1b-f0394d8f8833', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed098d2-61a8-4ceb-8761-e018dd0a4e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:13 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume volume-e38b364f-41c9-419c-9a1b-f0394d8f8833 (e38b364f-41c9-419c-9a1b-f0394d8f8833): created successfully Jul 03 14:09:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed098d2-61a8-4ceb-8761-e018dd0a4e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Flow 'volume_create_manager' (44430d35-bf0d-42c1-8988-6a7d47d8840c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:13 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-baa0b9d5-e877-467b-aff8-b3d525d8bc5f tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Created volume successfully. Jul 03 14:09:14 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387" returned: 0 in 0.816s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:14 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 Jul 03 14:09:14 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:14 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Flow 'volume_create_manager' (e0745720-eef9-4e04-b315-ff8e20fbba61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ed5426c-f924-46d1-8bd6-9e5cfcfaf5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ed5426c-f924-46d1-8bd6-9e5cfcfaf5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1323778615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11cc401-60a9-4e72-87e2-c6f0ea7694ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d3538e5344b0e8b4961c0b5296139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:15Z,use_quota=True,user_id='7d6af9e22f6249a18859dbc1578c39ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159101c1-3ce0-4601-bd0d-cec1dd320435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159101c1-3ce0-4601-bd0d-cec1dd320435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7184f303-1734-488c-adc9-8419f2911a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7184f303-1734-488c-adc9-8419f2911a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e11cc401-60a9-4e72-87e2-c6f0ea7694ff', 'volume_name': 'volume-e11cc401-60a9-4e72-87e2-c6f0ea7694ff', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8988eb49-b244-48ad-87fd-139bebba66a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8988eb49-b244-48ad-87fd-139bebba66a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1888506-b693-4664-9f37-6d52444024d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:15 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume e11cc401-60a9-4e72-87e2-c6f0ea7694ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e11cc401-60a9-4e72-87e2-c6f0ea7694ff', 'volume_size': 1} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1323778615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11cc401-60a9-4e72-87e2-c6f0ea7694ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d3538e5344b0e8b4961c0b5296139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:15Z,use_quota=True,user_id='7d6af9e22f6249a18859dbc1578c39ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Creating volume e11cc401-60a9-4e72-87e2-c6f0ea7694ff {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:15 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e11cc401-60a9-4e72-87e2-c6f0ea7694ff 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:15 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e11cc401-60a9-4e72-87e2-c6f0ea7694ff 1073741824 Jul 03 14:09:15 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:15 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804" returned: 0 in 0.896s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:15 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804 Jul 03 14:09:15 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Flow 'volume_create_manager' (196f2f8d-1e01-4a4d-9f5e-f44f4b5837f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bf6701-7dfd-40e6-820e-e0331ecc6dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bf6701-7dfd-40e6-820e-e0331ecc6dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-576682836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa73f85f-2dde-4ad9-bd03-b90971807354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d3538e5344b0e8b4961c0b5296139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:15Z,use_quota=True,user_id='7d6af9e22f6249a18859dbc1578c39ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e0fbdd-8f67-4cac-ab29-6342afed2f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e0fbdd-8f67-4cac-ab29-6342afed2f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96fab80-fc43-4722-8fab-8c993423649f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96fab80-fc43-4722-8fab-8c993423649f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa73f85f-2dde-4ad9-bd03-b90971807354', 'volume_name': 'volume-fa73f85f-2dde-4ad9-bd03-b90971807354', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c002fbdc-e440-4e0f-9e98-da5c6cf283db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c002fbdc-e440-4e0f-9e98-da5c6cf283db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e8473d-4277-41c2-bf75-6d9a34d34d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:15 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume fa73f85f-2dde-4ad9-bd03-b90971807354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa73f85f-2dde-4ad9-bd03-b90971807354', 'volume_size': 1} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Flow 'volume_create_manager' (c9d822d7-d9b8-48b7-813d-8be56e4a0c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea37054e-8eb6-4f1a-aaaf-8f63a04df91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:15 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387.70a95c53-4489-40f8-a1de-9bf492497804" returned: 0 in 0.860s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:16 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea37054e-8eb6-4f1a-aaaf-8f63a04df91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-260364959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f8307e-d51e-4b03-adff-76eb5f5d3049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d3538e5344b0e8b4961c0b5296139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:16Z,use_quota=True,user_id='7d6af9e22f6249a18859dbc1578c39ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1752bd-3705-4044-baf1-246ccddfcefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1752bd-3705-4044-baf1-246ccddfcefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81eca7a-a432-42c3-ac17-8c16971954e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81eca7a-a432-42c3-ac17-8c16971954e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38f8307e-d51e-4b03-adff-76eb5f5d3049', 'volume_name': 'volume-38f8307e-d51e-4b03-adff-76eb5f5d3049', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b1bef8-79a6-48ad-9caa-2155c5c4d9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b1bef8-79a6-48ad-9caa-2155c5c4d9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f5de77-25b3-47d9-b326-0d29e5bd4bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:16 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume 38f8307e-d51e-4b03-adff-76eb5f5d3049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38f8307e-d51e-4b03-adff-76eb5f5d3049', 'volume_size': 1} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e11cc401-60a9-4e72-87e2-c6f0ea7694ff 1073741824" returned: 0 in 1.039s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-quobyte-70a95c53-4489-40f8-a1de-9bf492497804" released by "_delete_snapshot" :: held 3.715s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-quobyte-b4d2431b-1c23-4f6d-831b-fbcc74957387" released by "delete_snapshot" :: held 3.747s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e11cc401-60a9-4e72-87e2-c6f0ea7694ff {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:16 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e11cc401-60a9-4e72-87e2-c6f0ea7694ff Jul 03 14:09:16 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] Created reservations ['14764846-0159-47ae-807a-65fac353aaea', '592819e7-a0dd-4bbc-90cc-d87393252f67', '7cd3434a-5efc-4a3d-bc36-fdfec53608eb', '50b214f6-981a-4cf1-a833-30de1e011a65'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:16 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] Delete snapshot completed successfully. Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-81e7c54b-313d-443a-8e10-ac2c72582a9f tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-70a95c53-4489-40f8-a1de-9bf492497804-delete_snapshot" released by "delete_snapshot" :: held 4.063s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Flow 'volume_create_manager' (c5c94f0e-3163-4250-9a74-56ed2df303db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bf060c-0d01-4d9f-9a46-8cca58c869af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bf060c-0d01-4d9f-9a46-8cca58c869af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256839251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84da5e4f-9207-442e-93d8-48d120cb502e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d3538e5344b0e8b4961c0b5296139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:16Z,use_quota=True,user_id='7d6af9e22f6249a18859dbc1578c39ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9966675f-e0ba-4ac9-af1a-7d4fba331722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9966675f-e0ba-4ac9-af1a-7d4fba331722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71588b8a-32b0-4513-a927-9b1e65c64a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71588b8a-32b0-4513-a927-9b1e65c64a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84da5e4f-9207-442e-93d8-48d120cb502e', 'volume_name': 'volume-84da5e4f-9207-442e-93d8-48d120cb502e', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ccb087-fa4d-470d-93d5-c13d1753279c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ccb087-fa4d-470d-93d5-c13d1753279c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb0715e-ac31-4f08-890e-10ce4dff6a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:16 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume 84da5e4f-9207-442e-93d8-48d120cb502e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84da5e4f-9207-442e-93d8-48d120cb502e', 'volume_size': 1} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-d7dca355-ff47-4c2a-b500-ff62ed55ad0b req-d6ff6b36-4783-4f0b-8dcc-396fa63e687b tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Flow 'volume_create_manager' (cc455bca-2bf4-4ce7-9779-4691b791aaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8a3be1-abd9-4e5d-99c4-6581a10680ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] Acquiring lock "cinder-b4d2431b-1c23-4f6d-831b-fbcc74957387-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8a3be1-abd9-4e5d-99c4-6581a10680ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1177410243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e64956-4826-4f7f-b8aa-c297f601d323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d3538e5344b0e8b4961c0b5296139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:17Z,use_quota=True,user_id='7d6af9e22f6249a18859dbc1578c39ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45155bb5-37c9-4bba-aa19-eac727745f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45155bb5-37c9-4bba-aa19-eac727745f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5d25c9-ce7c-4582-8213-a92700cef91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5d25c9-ce7c-4582-8213-a92700cef91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1e64956-4826-4f7f-b8aa-c297f601d323', 'volume_name': 'volume-c1e64956-4826-4f7f-b8aa-c297f601d323', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a5c1e3-4128-40d0-bd53-4b7001616867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a5c1e3-4128-40d0-bd53-4b7001616867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1264dd96-642a-45e4-9722-86f80b4c0fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:16 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume c1e64956-4826-4f7f-b8aa-c297f601d323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1e64956-4826-4f7f-b8aa-c297f601d323', 'volume_size': 1} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-b4d2431b-1c23-4f6d-831b-fbcc74957387-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] Acquiring lock "cinder-quobyte-b4d2431b-1c23-4f6d-831b-fbcc74957387" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:16 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-quobyte-b4d2431b-1c23-4f6d-831b-fbcc74957387" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e11cc401-60a9-4e72-87e2-c6f0ea7694ff" returned: 0 in 0.841s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.430s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-576682836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa73f85f-2dde-4ad9-bd03-b90971807354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d3538e5344b0e8b4961c0b5296139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:15Z,use_quota=True,user_id='7d6af9e22f6249a18859dbc1578c39ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Creating volume fa73f85f-2dde-4ad9-bd03-b90971807354 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:17 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:09:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fa73f85f-2dde-4ad9-bd03-b90971807354 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:17 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea75374-9466-4898-801a-54e2164652f9]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:17 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fa73f85f-2dde-4ad9-bd03-b90971807354 1073741824 Jul 03 14:09:17 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1888506-b693-4664-9f37-6d52444024d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e11cc401-60a9-4e72-87e2-c6f0ea7694ff', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc687437-052e-4b6e-9ca3-475db394d14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:17 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume volume-e11cc401-60a9-4e72-87e2-c6f0ea7694ff (e11cc401-60a9-4e72-87e2-c6f0ea7694ff): created successfully Jul 03 14:09:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc687437-052e-4b6e-9ca3-475db394d14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Flow 'volume_create_manager' (e0745720-eef9-4e04-b315-ff8e20fbba61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:17 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-6a27ef9e-6bc5-40ab-a469-161519869efe tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Created volume successfully. Jul 03 14:09:17 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387 Jul 03 14:09:17 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:17 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387" returned: 0 in 0.793s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:17 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387 Jul 03 14:09:17 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:17 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fa73f85f-2dde-4ad9-bd03-b90971807354 1073741824" returned: 0 in 0.977s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fa73f85f-2dde-4ad9-bd03-b90971807354 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:18 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fa73f85f-2dde-4ad9-bd03-b90971807354 Jul 03 14:09:18 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:18 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4d2431b-1c23-4f6d-831b-fbcc74957387" returned: 0 in 0.641s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-quobyte-b4d2431b-1c23-4f6d-831b-fbcc74957387" released by "delete_volume" :: held 1.505s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] Created reservations ['fa13be98-02b2-4cf4-bb94-f75d17220a2c', '4573aeb3-b7c0-49c8-9528-fb33d477f22d', 'fb81e4bd-d4b7-480a-9a5a-878b08b479e0', 'cb8c6b1d-b88f-4f21-9709-73bba0f8ab18'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:18 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:09:18 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:18 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fa73f85f-2dde-4ad9-bd03-b90971807354" returned: 0 in 0.664s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.615s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-260364959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f8307e-d51e-4b03-adff-76eb5f5d3049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d3538e5344b0e8b4961c0b5296139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:16Z,use_quota=True,user_id='7d6af9e22f6249a18859dbc1578c39ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Creating volume 38f8307e-d51e-4b03-adff-76eb5f5d3049 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:18 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-38f8307e-d51e-4b03-adff-76eb5f5d3049 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:18 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-38f8307e-d51e-4b03-adff-76eb5f5d3049 1073741824 Jul 03 14:09:18 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e8473d-4277-41c2-bf75-6d9a34d34d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa73f85f-2dde-4ad9-bd03-b90971807354', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c68b055-2af4-4adf-80c1-6a38c73cc340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:18 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume volume-fa73f85f-2dde-4ad9-bd03-b90971807354 (fa73f85f-2dde-4ad9-bd03-b90971807354): created successfully Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c68b055-2af4-4adf-80c1-6a38c73cc340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Flow 'volume_create_manager' (196f2f8d-1e01-4a4d-9f5e-f44f4b5837f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:18 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-267f8dc1-57c2-4d6a-a3ed-8a2d384b78a5 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Created volume successfully. Jul 03 14:09:19 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.717s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:19 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:19 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] Deleted volume successfully. Jul 03 14:09:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2fc05cad-9324-4837-97d4-d2051aac7578 tempest-VolumesSnapshotListTestJSON-1222240816 None] Lock "cinder-b4d2431b-1c23-4f6d-831b-fbcc74957387-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:19 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-38f8307e-d51e-4b03-adff-76eb5f5d3049 1073741824" returned: 0 in 0.903s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-38f8307e-d51e-4b03-adff-76eb5f5d3049 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:19 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-38f8307e-d51e-4b03-adff-76eb5f5d3049 Jul 03 14:09:19 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:20 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-38f8307e-d51e-4b03-adff-76eb5f5d3049" returned: 0 in 0.741s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.853s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256839251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84da5e4f-9207-442e-93d8-48d120cb502e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d3538e5344b0e8b4961c0b5296139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:16Z,use_quota=True,user_id='7d6af9e22f6249a18859dbc1578c39ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Creating volume 84da5e4f-9207-442e-93d8-48d120cb502e {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:20 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:09:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-84da5e4f-9207-442e-93d8-48d120cb502e 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f5de77-25b3-47d9-b326-0d29e5bd4bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f8307e-d51e-4b03-adff-76eb5f5d3049', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:20 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-84da5e4f-9207-442e-93d8-48d120cb502e 1073741824 Jul 03 14:09:20 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e11c03c-aa04-40f6-9c23-84ea388a7194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:20 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume volume-38f8307e-d51e-4b03-adff-76eb5f5d3049 (38f8307e-d51e-4b03-adff-76eb5f5d3049): created successfully Jul 03 14:09:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e11c03c-aa04-40f6-9c23-84ea388a7194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Flow 'volume_create_manager' (c9d822d7-d9b8-48b7-813d-8be56e4a0c10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:20 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e55f7c14-12b8-4b9e-9a02-e6d1c8e43e41 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Created volume successfully. Jul 03 14:09:21 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-84da5e4f-9207-442e-93d8-48d120cb502e 1073741824" returned: 0 in 0.877s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-84da5e4f-9207-442e-93d8-48d120cb502e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:21 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-84da5e4f-9207-442e-93d8-48d120cb502e Jul 03 14:09:21 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:21 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-84da5e4f-9207-442e-93d8-48d120cb502e" returned: 0 in 0.657s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-d7dca355-ff47-4c2a-b500-ff62ed55ad0b req-d6ff6b36-4783-4f0b-8dcc-396fa63e687b tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.321s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb0715e-ac31-4f08-890e-10ce4dff6a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84da5e4f-9207-442e-93d8-48d120cb502e', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d4ae10-f9da-41f6-9a7f-8a653348d889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:21 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5780d2a2-d17b-429a-a9b7-8552ef731ca6]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-d7dca355-ff47-4c2a-b500-ff62ed55ad0b req-d6ff6b36-4783-4f0b-8dcc-396fa63e687b tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:22 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume volume-84da5e4f-9207-442e-93d8-48d120cb502e (84da5e4f-9207-442e-93d8-48d120cb502e): created successfully Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d4ae10-f9da-41f6-9a7f-8a653348d889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Flow 'volume_create_manager' (c5c94f0e-3163-4250-9a74-56ed2df303db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:22 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e3ed9d0a-90dc-46fa-ac37-01c20984685e tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Created volume successfully. Jul 03 14:09:22 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7 Jul 03 14:09:22 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Flow 'volume_create_manager' (198cac6e-4eea-4027-ac50-689217bb681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c24347-b46c-41f8-9f72-a784a362bdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c24347-b46c-41f8-9f72-a784a362bdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-415790788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc96bc71-3675-41f1-bfda-7df61884e2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='252504003e9a481b84940d87659ced77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:22Z,use_quota=True,user_id='f9aa3d038d0a45339a3bfe24d4dd1cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa38c43-87a9-4799-9cce-115a2755db00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa38c43-87a9-4799-9cce-115a2755db00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c738b0-d601-4d51-9b08-dd0553868544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c738b0-d601-4d51-9b08-dd0553868544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc96bc71-3675-41f1-bfda-7df61884e2be', 'volume_name': 'volume-cc96bc71-3675-41f1-bfda-7df61884e2be', 'volume_size': 2}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05c3853-a047-4d93-bf5a-9d626ebd76e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05c3853-a047-4d93-bf5a-9d626ebd76e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624f80f7-c191-48a4-9fa4-8f13819a7689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:22 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Volume cc96bc71-3675-41f1-bfda-7df61884e2be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc96bc71-3675-41f1-bfda-7df61884e2be', 'volume_size': 2} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:22 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-d7dca355-ff47-4c2a-b500-ff62ed55ad0b req-d6ff6b36-4783-4f0b-8dcc-396fa63e687b tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7" returned: 0 in 0.817s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-d7dca355-ff47-4c2a-b500-ff62ed55ad0b req-d6ff6b36-4783-4f0b-8dcc-396fa63e687b tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.855s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.909s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1177410243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e64956-4826-4f7f-b8aa-c297f601d323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d3538e5344b0e8b4961c0b5296139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:17Z,use_quota=True,user_id='7d6af9e22f6249a18859dbc1578c39ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Creating volume c1e64956-4826-4f7f-b8aa-c297f601d323 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:22 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c1e64956-4826-4f7f-b8aa-c297f601d323 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:22 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c1e64956-4826-4f7f-b8aa-c297f601d323 1073741824 Jul 03 14:09:22 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-d7dca355-ff47-4c2a-b500-ff62ed55ad0b req-d6ff6b36-4783-4f0b-8dcc-396fa63e687b tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba1ca26a-6042-488a-aeec-9f999bff188f', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:09:23 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-d7dca355-ff47-4c2a-b500-ff62ed55ad0b req-d6ff6b36-4783-4f0b-8dcc-396fa63e687b tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] attachment_update completed successfully. Jul 03 14:09:23 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c1e64956-4826-4f7f-b8aa-c297f601d323 1073741824" returned: 0 in 0.900s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c1e64956-4826-4f7f-b8aa-c297f601d323 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:23 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c1e64956-4826-4f7f-b8aa-c297f601d323 Jul 03 14:09:23 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:24 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c1e64956-4826-4f7f-b8aa-c297f601d323" returned: 0 in 0.653s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.175s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-415790788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc96bc71-3675-41f1-bfda-7df61884e2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='252504003e9a481b84940d87659ced77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:22Z,use_quota=True,user_id='f9aa3d038d0a45339a3bfe24d4dd1cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Creating volume cc96bc71-3675-41f1-bfda-7df61884e2be {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:24 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:09:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be 2147483648 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1264dd96-642a-45e4-9722-86f80b4c0fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e64956-4826-4f7f-b8aa-c297f601d323', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:24 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be 2147483648 Jul 03 14:09:24 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36dc7f6-4ae6-4e3b-8a49-40afecb0eb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:24 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Volume volume-c1e64956-4826-4f7f-b8aa-c297f601d323 (c1e64956-4826-4f7f-b8aa-c297f601d323): created successfully Jul 03 14:09:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36dc7f6-4ae6-4e3b-8a49-40afecb0eb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Flow 'volume_create_manager' (cc455bca-2bf4-4ce7-9779-4691b791aaf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:24 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-140ab792-4485-4b8e-ae37-3a200c5b857c tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Created volume successfully. Jul 03 14:09:25 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be 2147483648" returned: 0 in 0.863s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:25 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be Jul 03 14:09:25 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "cinder-c1e64956-4826-4f7f-b8aa-c297f601d323-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-c1e64956-4826-4f7f-b8aa-c297f601d323-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "cinder-quobyte-c1e64956-4826-4f7f-b8aa-c297f601d323" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-quobyte-c1e64956-4826-4f7f-b8aa-c297f601d323" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:25 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0023bd82-b481-459d-bc1a-8ae47b26b478]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c1e64956-4826-4f7f-b8aa-c297f601d323 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:25 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c1e64956-4826-4f7f-b8aa-c297f601d323 Jul 03 14:09:25 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:25 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be" returned: 0 in 0.667s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624f80f7-c191-48a4-9fa4-8f13819a7689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc96bc71-3675-41f1-bfda-7df61884e2be', 'volume_size': 2}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e46c5759-b173-4e04-b23c-f1c5d861b34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:26 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Volume volume-cc96bc71-3675-41f1-bfda-7df61884e2be (cc96bc71-3675-41f1-bfda-7df61884e2be): created successfully Jul 03 14:09:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e46c5759-b173-4e04-b23c-f1c5d861b34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Flow 'volume_create_manager' (198cac6e-4eea-4027-ac50-689217bb681b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:26 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-60f0775d-6b19-493d-95ac-a064669b4029 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Created volume successfully. Jul 03 14:09:26 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c1e64956-4826-4f7f-b8aa-c297f601d323" returned: 0 in 0.811s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c1e64956-4826-4f7f-b8aa-c297f601d323 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:26 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c1e64956-4826-4f7f-b8aa-c297f601d323 Jul 03 14:09:26 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Creating offline snapshot 9c954daa-f6b8-4765-8ad8-bb57d4151a20 of volume cc96bc71-3675-41f1-bfda-7df61884e2be {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:09:26 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9041be24-f350-498f-9679-2b7db84a2c50]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:26 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be Jul 03 14:09:26 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:27 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-c1e64956-4826-4f7f-b8aa-c297f601d323" returned: 0 in 0.697s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-quobyte-c1e64956-4826-4f7f-b8aa-c297f601d323" released by "delete_volume" :: held 1.558s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:27 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Created reservations ['7d86f97b-489b-442b-9cd0-97fbe15a64b9', '1062f470-7a4b-4289-bf4d-cb7fdb35e99c', '4b979ae4-2981-4e26-99de-e2ad9fa808c1', '49e6ae94-8029-48c8-a9c9-c1e9d305e3a7'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:27 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:09:27 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:27 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be" returned: 0 in 0.875s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20 2G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:27 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20 2G Jul 03 14:09:27 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "cinder-84da5e4f-9207-442e-93d8-48d120cb502e-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-84da5e4f-9207-442e-93d8-48d120cb502e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "cinder-quobyte-84da5e4f-9207-442e-93d8-48d120cb502e" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-quobyte-84da5e4f-9207-442e-93d8-48d120cb502e" acquired by "delete_volume" :: waited 0.029s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:27 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5341f5-64ff-422b-a953-00cb8f3d6565]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-84da5e4f-9207-442e-93d8-48d120cb502e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:28 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-84da5e4f-9207-442e-93d8-48d120cb502e Jul 03 14:09:28 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:28 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.873s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:28 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Deleted volume successfully. Jul 03 14:09:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9b66ae8c-9171-412d-87c4-2f5162b3c4e2 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-c1e64956-4826-4f7f-b8aa-c297f601d323-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:28 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20 2G" returned: 0 in 0.988s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc96bc71-3675-41f1-bfda-7df61884e2be -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:28 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc96bc71-3675-41f1-bfda-7df61884e2be -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20 Jul 03 14:09:28 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:28 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-84da5e4f-9207-442e-93d8-48d120cb502e" returned: 0 in 0.869s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-84da5e4f-9207-442e-93d8-48d120cb502e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:28 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-84da5e4f-9207-442e-93d8-48d120cb502e Jul 03 14:09:28 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:29 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc96bc71-3675-41f1-bfda-7df61884e2be -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20" returned: 0 in 0.713s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:29 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20 is being set with open permissions: ugo+rw Jul 03 14:09:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:29 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20 Jul 03 14:09:29 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:29 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-84da5e4f-9207-442e-93d8-48d120cb502e" returned: 0 in 0.760s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-quobyte-84da5e4f-9207-442e-93d8-48d120cb502e" released by "delete_volume" :: held 1.722s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:29 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-62e3c54d-e371-4e3d-8615-30a56b56c03e req-9bece79a-c4dd-49d4-ac44-665e7028987c tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Terminate volume connection completed successfully. Jul 03 14:09:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-62e3c54d-e371-4e3d-8615-30a56b56c03e req-9bece79a-c4dd-49d4-ac44-665e7028987c tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Deleting attachment ba1ca26a-6042-488a-aeec-9f999bff188f. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:09:29 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Created reservations ['ec6aef37-32cd-4119-ab6d-2bf41a480070', '3504912e-d875-4a86-a837-e91bb8648457', 'de40bffc-b074-4fe1-b6bc-1fa498e266b0', '2e2d3984-1002-4a32-82c7-710a4bc7f4c0'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:29 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:09:29 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:29 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20" returned: 0 in 0.703s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:29 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.info Jul 03 14:09:29 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "cinder-38f8307e-d51e-4b03-adff-76eb5f5d3049-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-38f8307e-d51e-4b03-adff-76eb5f5d3049-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "cinder-quobyte-38f8307e-d51e-4b03-adff-76eb5f5d3049" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-quobyte-38f8307e-d51e-4b03-adff-76eb5f5d3049" acquired by "delete_volume" :: waited 0.026s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:30 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5458daeb-0b73-420e-90b7-ae11b31b311b]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-38f8307e-d51e-4b03-adff-76eb5f5d3049 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:30 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-38f8307e-d51e-4b03-adff-76eb5f5d3049 Jul 03 14:09:30 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:30 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.682s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:30 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:30 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Deleted volume successfully. Jul 03 14:09:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e30fab1-a29a-4fe5-a762-c71b151f4344 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-84da5e4f-9207-442e-93d8-48d120cb502e-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:30 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.info" returned: 0 in 0.834s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:30 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.info is being set with open permissions: ugo+rw Jul 03 14:09:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:30 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.info Jul 03 14:09:30 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:31 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-38f8307e-d51e-4b03-adff-76eb5f5d3049" returned: 0 in 0.869s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-38f8307e-d51e-4b03-adff-76eb5f5d3049 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:31 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-38f8307e-d51e-4b03-adff-76eb5f5d3049 Jul 03 14:09:31 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:31 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.info" returned: 0 in 0.664s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.871s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:31 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-af780ba4-de12-4d80-8e30-05076e839491 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Create snapshot completed successfully Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Acquiring lock "cinder-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:31 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-38f8307e-d51e-4b03-adff-76eb5f5d3049" returned: 0 in 0.741s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Lock "cinder-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-quobyte-38f8307e-d51e-4b03-adff-76eb5f5d3049" released by "delete_volume" :: held 1.681s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Acquiring lock "cinder-quobyte-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Acquiring lock "cinder-9c954daa-f6b8-4765-8ad8-bb57d4151a20-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Lock "cinder-quobyte-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7" acquired by "delete_volume" :: waited 0.031s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "cinder-9c954daa-f6b8-4765-8ad8-bb57d4151a20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Acquiring lock "cinder-quobyte-cc96bc71-3675-41f1-bfda-7df61884e2be" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a571c6-40b9-4b74-ab06-11ca1c1ef8c1]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "cinder-quobyte-cc96bc71-3675-41f1-bfda-7df61884e2be" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Acquiring lock "cinder-quobyte-9c954daa-f6b8-4765-8ad8-bb57d4151a20" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Created reservations ['62860417-4633-40d3-b19d-833ad9238bfc', '85683e4d-1fcb-45b4-bd37-31c7592e215e', '125b0a47-6f16-41ca-b092-c1540f8577ac', 'af3f9c0a-ac5c-40ea-a1e7-fc26f4bba85a'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "cinder-quobyte-9c954daa-f6b8-4765-8ad8-bb57d4151a20" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Deleting offline snapshot 9c954daa-f6b8-4765-8ad8-bb57d4151a20 of volume cc96bc71-3675-41f1-bfda-7df61884e2be {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] snapshot_file for this snap is: volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[be709bbe-70fc-4c24-a660-96bc35f79b9a]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:32 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7 Jul 03 14:09:32 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:32 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:09:32 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:32 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20 Jul 03 14:09:32 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "cinder-fa73f85f-2dde-4ad9-bd03-b90971807354-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-fa73f85f-2dde-4ad9-bd03-b90971807354-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "cinder-quobyte-fa73f85f-2dde-4ad9-bd03-b90971807354" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-quobyte-fa73f85f-2dde-4ad9-bd03-b90971807354" acquired by "delete_volume" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[00413596-7018-4ce6-89b9-61ed45af1b01]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fa73f85f-2dde-4ad9-bd03-b90971807354 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:32 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fa73f85f-2dde-4ad9-bd03-b90971807354 Jul 03 14:09:32 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:32 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.767s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:32 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Deleted volume successfully. Jul 03 14:09:32 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7" returned: 0 in 0.956s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ccf348ae-3b3b-4a56-8957-4faa74430354 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-38f8307e-d51e-4b03-adff-76eb5f5d3049-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:32 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7 Jul 03 14:09:32 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:32 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20" returned: 0 in 0.959s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc96bc71-3675-41f1-bfda-7df61884e2be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:09:33 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6690d36-a6b8-40d1-bcfa-158707959057]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:33 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be Jul 03 14:09:33 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:33 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fa73f85f-2dde-4ad9-bd03-b90971807354" returned: 0 in 0.945s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fa73f85f-2dde-4ad9-bd03-b90971807354 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:33 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fa73f85f-2dde-4ad9-bd03-b90971807354 Jul 03 14:09:33 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:33 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7" returned: 0 in 0.783s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Lock "cinder-quobyte-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7" released by "delete_volume" :: held 1.796s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:33 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Created reservations ['ac7ba6c7-0664-4677-a8ba-a6ee0a1fbfe6', 'c64ea3ce-7d81-4e71-8de0-e5b01324367e', 'acbf5a17-ac16-4278-8b8a-ba21778f2b4c', 'd49e7f09-9155-4999-b842-0354c02b5d19'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:33 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:33 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:09:33 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be" returned: 0 in 0.842s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:33 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20 Jul 03 14:09:33 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:34 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fa73f85f-2dde-4ad9-bd03-b90971807354" returned: 0 in 0.742s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-quobyte-fa73f85f-2dde-4ad9-bd03-b90971807354" released by "delete_volume" :: held 1.741s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Created reservations ['a050bd38-1570-4bc1-8a22-ff18df281a16', 'e64ea706-f370-4a3c-ae1f-584acfdc9937', 'd6cd06f7-fc46-40fa-b485-72a5ac08c2a6', 'c2876364-8395-4076-a2b9-2bd43b61e942'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:34 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:09:34 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "cinder-e11cc401-60a9-4e72-87e2-c6f0ea7694ff-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:34 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.830s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Deleted volume successfully. Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-e11cc401-60a9-4e72-87e2-c6f0ea7694ff-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-90cad3db-2f6b-4c0a-9fee-7fb5a6f04b96 tempest-TestServerVolumeAttachScenarioOldVersion-1507593615 None] Lock "cinder-f73a5ca8-dcb3-4263-93ec-9efd6e6ddcd7-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "cinder-quobyte-e11cc401-60a9-4e72-87e2-c6f0ea7694ff" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-quobyte-e11cc401-60a9-4e72-87e2-c6f0ea7694ff" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ef40df-c157-4a46-a168-a09b92980bfc]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e11cc401-60a9-4e72-87e2-c6f0ea7694ff {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:34 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20" returned: 0 in 0.974s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:34 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20 Jul 03 14:09:34 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:34 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e11cc401-60a9-4e72-87e2-c6f0ea7694ff Jul 03 14:09:34 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:35 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.787s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:35 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:35 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Deleted volume successfully. Jul 03 14:09:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c739bf20-ac98-4d4d-ae49-208365ddc2bc tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-fa73f85f-2dde-4ad9-bd03-b90971807354-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:35 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e11cc401-60a9-4e72-87e2-c6f0ea7694ff" returned: 0 in 0.858s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e11cc401-60a9-4e72-87e2-c6f0ea7694ff {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:35 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be.9c954daa-f6b8-4765-8ad8-bb57d4151a20" returned: 0 in 0.831s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:35 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e11cc401-60a9-4e72-87e2-c6f0ea7694ff Jul 03 14:09:35 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "cinder-quobyte-9c954daa-f6b8-4765-8ad8-bb57d4151a20" released by "_delete_snapshot" :: held 3.743s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "cinder-quobyte-cc96bc71-3675-41f1-bfda-7df61884e2be" released by "delete_snapshot" :: held 3.780s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:35 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Created reservations ['889b969f-c418-4b15-97fc-c3668b694ff9', '7e22650b-d83d-4aa7-b79f-68a62a42578f', '66dbb3d0-8168-41e7-aa1f-2d72e6e5a81d', '37b06b58-0079-4f5d-ab4d-a61b564f2e87'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:35 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Delete snapshot completed successfully. Jul 03 14:09:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e5718a4-a937-479d-a64d-c715b86f2b75 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "cinder-9c954daa-f6b8-4765-8ad8-bb57d4151a20-delete_snapshot" released by "delete_snapshot" :: held 3.987s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Acquiring lock "cinder-cc96bc71-3675-41f1-bfda-7df61884e2be-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "cinder-cc96bc71-3675-41f1-bfda-7df61884e2be-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Acquiring lock "cinder-quobyte-cc96bc71-3675-41f1-bfda-7df61884e2be" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "cinder-quobyte-cc96bc71-3675-41f1-bfda-7df61884e2be" acquired by "delete_volume" :: waited 0.014s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:36 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b110639-30d5-4c73-8e2c-ba20113059c9]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:36 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e11cc401-60a9-4e72-87e2-c6f0ea7694ff" returned: 0 in 0.781s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:36 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be Jul 03 14:09:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-quobyte-e11cc401-60a9-4e72-87e2-c6f0ea7694ff" released by "delete_volume" :: held 1.707s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:36 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:36 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Created reservations ['c03c8e79-2865-4838-ab87-83a83e39c534', '3fad3a9c-2824-4dad-bd15-d30fff46753c', '05ca2d48-f082-4bde-ade2-198e7ee41b05', '3d1376dc-e902-4b59-9977-e4271886ff31'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:36 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:09:36 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "cinder-e38b364f-41c9-419c-9a1b-f0394d8f8833-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-e38b364f-41c9-419c-9a1b-f0394d8f8833-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "cinder-quobyte-e38b364f-41c9-419c-9a1b-f0394d8f8833" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-quobyte-e38b364f-41c9-419c-9a1b-f0394d8f8833" acquired by "delete_volume" :: waited 0.045s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:37 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f3f83d-1a4a-4caf-b6e6-61b1b861cdaf]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e38b364f-41c9-419c-9a1b-f0394d8f8833 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:37 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be" returned: 0 in 0.926s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:37 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e38b364f-41c9-419c-9a1b-f0394d8f8833 Jul 03 14:09:37 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:37 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be Jul 03 14:09:37 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:37 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.784s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:37 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:37 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Deleted volume successfully. Jul 03 14:09:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ba964a02-76c6-463a-8660-957ce2dbcf07 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-e11cc401-60a9-4e72-87e2-c6f0ea7694ff-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:38 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e38b364f-41c9-419c-9a1b-f0394d8f8833" returned: 0 in 1.051s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e38b364f-41c9-419c-9a1b-f0394d8f8833 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:38 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cc96bc71-3675-41f1-bfda-7df61884e2be" returned: 0 in 0.928s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:38 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e38b364f-41c9-419c-9a1b-f0394d8f8833 Jul 03 14:09:38 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "cinder-quobyte-cc96bc71-3675-41f1-bfda-7df61884e2be" released by "delete_volume" :: held 1.911s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:38 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Created reservations ['62a0d80d-cfd9-4d5d-bed9-7748b6aba6ff', 'f8a56dc0-d5ea-49a7-be3c-c7ae56581525', '6341ec14-b05a-4c09-9bc4-e4be70574727', '9dcc55e2-263f-4bce-bfb0-a4b5e54c0b95'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:38 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:09:38 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:38 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e38b364f-41c9-419c-9a1b-f0394d8f8833" returned: 0 in 0.677s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-quobyte-e38b364f-41c9-419c-9a1b-f0394d8f8833" released by "delete_volume" :: held 1.785s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:38 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Created reservations ['cd9209c1-312c-4ff7-94a2-3d970971fa31', 'cc436a17-876c-46bc-bd61-00da8f2178ec', '350a582f-bab4-412d-8155-e630857c113d', 'a44f4bea-5c85-4537-9d61-650c30a5c27e'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:39 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:09:39 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:39 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.816s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:39 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:39 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Deleted volume successfully. Jul 03 14:09:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-66077531-8fd0-48f2-b112-d2f7cf3824f8 tempest-VolumesSnapshotNegativeTestJSON-1213779646 None] Lock "cinder-cc96bc71-3675-41f1-bfda-7df61884e2be-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:39 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.768s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:39 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:39 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Deleted volume successfully. Jul 03 14:09:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67998443-1748-43b3-babf-a47a4dfa3c16 tempest-CreateVolumesFromSourceVolumeTest-2077784337 None] Lock "cinder-e38b364f-41c9-419c-9a1b-f0394d8f8833-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:45 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Flow 'volume_create_manager' (5170b494-d57f-489b-8cb3-a544d928acc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3f2ac96-8b0a-410b-99cf-492faf6ba066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3f2ac96-8b0a-410b-99cf-492faf6ba066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9542c207-2b92-40d7-ab14-98f2bf33e148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee61b46bf664bc0ba607de2c7a82cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:45Z,use_quota=True,user_id='e8da685b5e7d4a9fb0db443248fc1b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e408922-b5a6-456e-a368-241065ed9064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e408922-b5a6-456e-a368-241065ed9064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944ea80c-3f61-43f0-b19d-fa16e862ffda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:45 devstack cinder-volume[86805]: DEBUG cinder.image.glance [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Creating Keystone auth plugin from conf {{(pid=86805) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 14:09:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944ea80c-3f61-43f0-b19d-fa16e862ffda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9542c207-2b92-40d7-ab14-98f2bf33e148', 'volume_name': 'volume-9542c207-2b92-40d7-ab14-98f2bf33e148', 'volume_size': 1, 'image_id': 'f1a1f83b-93d2-410c-bd26-74f44bccd980', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f1a1f83b-93d2-410c-bd26-74f44bccd980', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b93ec6c920e090c5a395bd1e5d935747', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ee61b46bf664bc0ba607de2c7a82cd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bc3a199ea714e455d4cd720dc7a22eafcfd3fec78c58494e7d4fa511eca7f9376263524acfe7ea4768287d8315e493038e4f54eaf06123b51ac24e1711f21b0c', 'id': 'f1a1f83b-93d2-410c-bd26-74f44bccd980', 'created_at': datetime.datetime(2026, 7, 3, 12, 9, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1a1f83b-93d2-410c-bd26-74f44bccd980/file', 'properties': {}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516bd9e2-248a-4d23-bc66-329c89bba9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516bd9e2-248a-4d23-bc66-329c89bba9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d58e7b-7c96-48ac-afb2-f246f160036a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:45 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Volume 9542c207-2b92-40d7-ab14-98f2bf33e148: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9542c207-2b92-40d7-ab14-98f2bf33e148', 'volume_size': 1, 'image_id': 'f1a1f83b-93d2-410c-bd26-74f44bccd980', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f1a1f83b-93d2-410c-bd26-74f44bccd980', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b93ec6c920e090c5a395bd1e5d935747', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ee61b46bf664bc0ba607de2c7a82cd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bc3a199ea714e455d4cd720dc7a22eafcfd3fec78c58494e7d4fa511eca7f9376263524acfe7ea4768287d8315e493038e4f54eaf06123b51ac24e1711f21b0c', 'id': 'f1a1f83b-93d2-410c-bd26-74f44bccd980', 'created_at': datetime.datetime(2026, 7, 3, 12, 9, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1a1f83b-93d2-410c-bd26-74f44bccd980/file', 'properties': {}}, 'image_service': } Jul 03 14:09:45 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Trying to clone 9542c207-2b92-40d7-ab14-98f2bf33e148 from image f1a1f83b-93d2-410c-bd26-74f44bccd980 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f1a1f83b-93d2-410c-bd26-74f44bccd980', 'metadata': {}}]). {{(pid=86805) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 14:09:45 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 14:09:45 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Image download 0.00 MB at 0.00 MB/s Jul 03 14:09:45 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8eb2c5-0591-4b96-bf18-1bb36d9f3e5f]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:46 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD Jul 03 14:09:46 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:46 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD" returned: 0 in 0.929s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:47 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD Jul 03 14:09:47 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:47 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD" returned: 1 in 0.891s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:09:47 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Temporary image f1a1f83b-93d2-410c-bd26-74f44bccd980 is fetched for user e8da685b5e7d4a9fb0db443248fc1b44. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 14:09:47 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f876d1-7988-44f9-8835-7a1c73bb7f54]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:48 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD Jul 03 14:09:48 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:48 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD" returned: 0 in 0.839s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:48 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD Jul 03 14:09:48 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:49 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD" returned: 1 in 0.840s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:09:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9542c207-2b92-40d7-ab14-98f2bf33e148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee61b46bf664bc0ba607de2c7a82cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:45Z,use_quota=True,user_id='e8da685b5e7d4a9fb0db443248fc1b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Creating volume 9542c207-2b92-40d7-ab14-98f2bf33e148 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:49 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:09:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:49 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 1073741824 Jul 03 14:09:49 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:50 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 1073741824" returned: 0 in 1.087s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:50 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 Jul 03 14:09:50 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:51 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148" returned: 0 in 0.858s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:51 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] <== create_volume: return (2032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:51 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=130,cinder:UPDATE=178,cinder:DELETE=16,cinder:INSERT=45 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:09:51 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=136,cinder:UPDATE=160,cinder:INSERT=51,cinder:DELETE=11 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:09:51 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Attempting download of f1a1f83b-93d2-410c-bd26-74f44bccd980 ((None, [{'url': 'file:///opt/stack/data/glance/images/f1a1f83b-93d2-410c-bd26-74f44bccd980', 'metadata': {}}])) to volume 9542c207-2b92-40d7-ab14-98f2bf33e148. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 14:09:51 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba81f76-2ba6-4e39-be36-5aa760b6cac4]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f1a1f83b-93d2-410c-bd26-74f44bccd980_2fxjydx9 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:51 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f1a1f83b-93d2-410c-bd26-74f44bccd980_2fxjydx9 Jul 03 14:09:51 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:52 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f1a1f83b-93d2-410c-bd26-74f44bccd980_2fxjydx9" returned: 0 in 1.062s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1a1f83b-93d2-410c-bd26-74f44bccd980_2fxjydx9 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:53 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1a1f83b-93d2-410c-bd26-74f44bccd980_2fxjydx9 Jul 03 14:09:53 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:53 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1a1f83b-93d2-410c-bd26-74f44bccd980_2fxjydx9" returned: 1 in 0.958s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1a1f83b-93d2-410c-bd26-74f44bccd980_2fxjydx9' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:09:53 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5706813b-9418-4c6b-943c-4790ae80cda4]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:53 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD Jul 03 14:09:53 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:54 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD" returned: 0 in 0.761s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:54 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD Jul 03 14:09:54 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:55 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD" returned: 1 in 0.873s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:09:55 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] f1a1f83b-93d2-410c-bd26-74f44bccd980 was raw, converting to raw {{(pid=86805) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 14:09:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:55 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 Jul 03 14:09:55 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:56 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148" returned: 0 in 1.092s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:56 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f1a1f83b-93d2-410c-bd26-74f44bccd980_4_rqigncdevstack@QuobyteHD, size 0.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:09:56 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 14:09:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:56 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 1G Jul 03 14:09:56 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:57 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 1G" returned: 0 in 0.850s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:57 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3d3311-2fe1-4202-9b8d-817cfbaf3c65]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:57 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 Jul 03 14:09:57 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:09:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:58 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148" returned: 0 in 1.037s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:58 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:09:58 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:58 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 Jul 03 14:09:58 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:59 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.963s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:59 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148" returned: 1 in 1.156s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:09:59 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Downloaded image f1a1f83b-93d2-410c-bd26-74f44bccd980 ((None, [{'url': 'file:///opt/stack/data/glance/images/f1a1f83b-93d2-410c-bd26-74f44bccd980', 'metadata': {}}])) to volume 9542c207-2b92-40d7-ab14-98f2bf33e148 successfully. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 14:09:59 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Temporary image f1a1f83b-93d2-410c-bd26-74f44bccd980 for user e8da685b5e7d4a9fb0db443248fc1b44 is deleted. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 14:09:59 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Marking volume 9542c207-2b92-40d7-ab14-98f2bf33e148 as bootable. {{(pid=86805) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 14:09:59 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Copying metadata from image f1a1f83b-93d2-410c-bd26-74f44bccd980 to 9542c207-2b92-40d7-ab14-98f2bf33e148. {{(pid=86805) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 14:09:59 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Creating volume glance metadata for volume 9542c207-2b92-40d7-ab14-98f2bf33e148 backed by image f1a1f83b-93d2-410c-bd26-74f44bccd980 with: {'image_id': 'f1a1f83b-93d2-410c-bd26-74f44bccd980', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b93ec6c920e090c5a395bd1e5d935747', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86805) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 14:09:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d58e7b-7c96-48ac-afb2-f246f160036a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9542c207-2b92-40d7-ab14-98f2bf33e148', 'volume_size': 1, 'image_id': 'f1a1f83b-93d2-410c-bd26-74f44bccd980', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f1a1f83b-93d2-410c-bd26-74f44bccd980', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b93ec6c920e090c5a395bd1e5d935747', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ee61b46bf664bc0ba607de2c7a82cd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bc3a199ea714e455d4cd720dc7a22eafcfd3fec78c58494e7d4fa511eca7f9376263524acfe7ea4768287d8315e493038e4f54eaf06123b51ac24e1711f21b0c', 'id': 'f1a1f83b-93d2-410c-bd26-74f44bccd980', 'created_at': datetime.datetime(2026, 7, 3, 12, 9, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 9, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1a1f83b-93d2-410c-bd26-74f44bccd980/file', 'properties': {}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17996ab-0324-44a1-906c-45d9d5ae5fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:59 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Volume volume-9542c207-2b92-40d7-ab14-98f2bf33e148 (9542c207-2b92-40d7-ab14-98f2bf33e148): created successfully Jul 03 14:09:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17996ab-0324-44a1-906c-45d9d5ae5fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Flow 'volume_create_manager' (5170b494-d57f-489b-8cb3-a544d928acc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:59 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b2bb0347-6d68-44be-8448-b9ac2f085335 tempest-VolumeImageDependencyTests-377827675 None] Created volume successfully. Jul 03 14:10:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Acquiring lock "cinder-9542c207-2b92-40d7-ab14-98f2bf33e148-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Lock "cinder-9542c207-2b92-40d7-ab14-98f2bf33e148-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Acquiring lock "cinder-quobyte-9542c207-2b92-40d7-ab14-98f2bf33e148" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:00 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Lock "cinder-quobyte-9542c207-2b92-40d7-ab14-98f2bf33e148" acquired by "delete_volume" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:00 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d23771-2a60-49b5-b8d5-f9e030c829f2]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:01 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 Jul 03 14:10:01 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:01 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148" returned: 0 in 1.058s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:02 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 Jul 03 14:10:02 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:02 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148" returned: 1 in 0.888s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:10:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:02 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148 Jul 03 14:10:02 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:03 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9542c207-2b92-40d7-ab14-98f2bf33e148" returned: 0 in 0.792s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:03 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Lock "cinder-quobyte-9542c207-2b92-40d7-ab14-98f2bf33e148" released by "delete_volume" :: held 2.853s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:03 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Created reservations ['59854f3f-4eb2-412e-a482-f25dc462f2d8', '51d9dd69-c48a-481e-a2df-491a5fcf3438', 'a9d1af19-0dea-4ea6-a575-6f0e1e9c2ff7', '86e3d4d2-90ae-43da-b6e1-ba46d80b716b'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:03 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:03 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:03 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:10:03 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:04 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.944s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:04 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:10:04 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Deleted volume successfully. Jul 03 14:10:04 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a018ff04-88b4-4230-918f-4d8c9da550a1 tempest-VolumeImageDependencyTests-377827675 None] Lock "cinder-9542c207-2b92-40d7-ab14-98f2bf33e148-delete_volume" released by "delete_volume" :: held 4.145s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:10 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:10:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Flow 'volume_create_manager' (0f2f2c45-569c-48d0-86d0-34a32fd15118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efddd3b-77ad-48b3-8e47-c47373ac0ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efddd3b-77ad-48b3-8e47-c47373ac0ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1678720359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea233894-ff7c-4077-84ed-14630fac3484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7423b76a27f4d10976473d05619dad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:11Z,use_quota=True,user_id='c1c119865f8c44bfa4f1e8ae88092e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031a31b5-3892-4b02-90f8-7e15ae212be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031a31b5-3892-4b02-90f8-7e15ae212be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2829f26f-7d0b-450c-9059-c8c5394d77ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:11 devstack cinder-volume[86805]: DEBUG cinder.image.glance [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Creating Keystone auth plugin from conf {{(pid=86805) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 14:10:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2829f26f-7d0b-450c-9059-c8c5394d77ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ea233894-ff7c-4077-84ed-14630fac3484', 'volume_name': 'volume-ea233894-ff7c-4077-84ed-14630fac3484', 'volume_size': 1, 'image_id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '50c6afe76f7e4b1c8c512d52058b3c26', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'created_at': datetime.datetime(2026, 7, 3, 11, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14be8f8b-de0c-4029-a83f-c66e4cebc518/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5405ab2e-20fa-41ff-b54e-943cb54935e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5405ab2e-20fa-41ff-b54e-943cb54935e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19929a2-10b3-4863-8ccd-53549dc41ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:11 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Volume ea233894-ff7c-4077-84ed-14630fac3484: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ea233894-ff7c-4077-84ed-14630fac3484', 'volume_size': 1, 'image_id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '50c6afe76f7e4b1c8c512d52058b3c26', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'created_at': datetime.datetime(2026, 7, 3, 11, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14be8f8b-de0c-4029-a83f-c66e4cebc518/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 14:10:11 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Trying to clone ea233894-ff7c-4077-84ed-14630fac3484 from image 14be8f8b-de0c-4029-a83f-c66e4cebc518 at location (None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}]). {{(pid=86805) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 14:10:12 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_mld90ul6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 14:10:12 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Image download 20.69 MB at 20.69 MB/s Jul 03 14:10:12 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ca87b6-c172-408c-b4b7-ef5f936990e0]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_mld90ul6devstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:12 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_mld90ul6devstack@QuobyteHD Jul 03 14:10:12 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:13 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_mld90ul6devstack@QuobyteHD" returned: 0 in 1.101s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:13 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Temporary image 14be8f8b-de0c-4029-a83f-c66e4cebc518 is fetched for user c1c119865f8c44bfa4f1e8ae88092e6c. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 14:10:13 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[12489ac8-9985-428c-9109-ae683c9a5173]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_mld90ul6devstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:13 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_mld90ul6devstack@QuobyteHD Jul 03 14:10:13 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:14 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_mld90ul6devstack@QuobyteHD" returned: 0 in 0.774s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1678720359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea233894-ff7c-4077-84ed-14630fac3484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7423b76a27f4d10976473d05619dad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:11Z,use_quota=True,user_id='c1c119865f8c44bfa4f1e8ae88092e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:10:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Creating volume ea233894-ff7c-4077-84ed-14630fac3484 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:10:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:10:14 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:10:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:14 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 1073741824 Jul 03 14:10:14 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:14 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 1073741824" returned: 0 in 0.846s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:15 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 Jul 03 14:10:15 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:15 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484" returned: 0 in 0.655s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:10:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:15 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Attempting download of 14be8f8b-de0c-4029-a83f-c66e4cebc518 ((None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}])) to volume ea233894-ff7c-4077-84ed-14630fac3484. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 14:10:15 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9273a12b-4fcd-4592-a6b3-3cd9b856e4c8]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_ce45qgsx {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:15 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_ce45qgsx Jul 03 14:10:15 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:16 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_ce45qgsx" returned: 0 in 0.709s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_ce45qgsx {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:16 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_ce45qgsx Jul 03 14:10:16 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:17 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_ce45qgsx" returned: 1 in 0.719s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14be8f8b-de0c-4029-a83f-c66e4cebc518_ce45qgsx' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:10:17 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[532aa921-9ffe-4f25-b6fb-6305e592b16e]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_mld90ul6devstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:17 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_mld90ul6devstack@QuobyteHD Jul 03 14:10:17 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:17 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_mld90ul6devstack@QuobyteHD" returned: 0 in 0.741s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:17 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] 14be8f8b-de0c-4029-a83f-c66e4cebc518 was qcow2, converting to raw {{(pid=86805) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 14:10:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_mld90ul6devstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:17 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_mld90ul6devstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 Jul 03 14:10:17 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:20 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_mld90ul6devstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484" returned: 0 in 2.141s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:20 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_14be8f8b-de0c-4029-a83f-c66e4cebc518_mld90ul6devstack@QuobyteHD, size 112.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:10:20 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Converted 112.00 MB image at 52.29 MB/s Jul 03 14:10:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:20 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 1G Jul 03 14:10:20 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:20 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 1G" returned: 0 in 0.742s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:20 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f32070-8569-4607-8d58-c6cdb018a705]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:20 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 Jul 03 14:10:20 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:21 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484" returned: 0 in 0.855s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:21 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 Jul 03 14:10:21 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:22 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484" returned: 1 in 0.741s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:10:22 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Downloaded image 14be8f8b-de0c-4029-a83f-c66e4cebc518 ((None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}])) to volume ea233894-ff7c-4077-84ed-14630fac3484 successfully. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 14:10:22 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Temporary image 14be8f8b-de0c-4029-a83f-c66e4cebc518 for user c1c119865f8c44bfa4f1e8ae88092e6c is deleted. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 14:10:22 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Marking volume ea233894-ff7c-4077-84ed-14630fac3484 as bootable. {{(pid=86805) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 14:10:22 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Copying metadata from image 14be8f8b-de0c-4029-a83f-c66e4cebc518 to ea233894-ff7c-4077-84ed-14630fac3484. {{(pid=86805) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 14:10:22 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Creating volume glance metadata for volume ea233894-ff7c-4077-84ed-14630fac3484 backed by image 14be8f8b-de0c-4029-a83f-c66e4cebc518 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86805) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 14:10:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19929a2-10b3-4863-8ccd-53549dc41ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea233894-ff7c-4077-84ed-14630fac3484', 'volume_size': 1, 'image_id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14be8f8b-de0c-4029-a83f-c66e4cebc518', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '50c6afe76f7e4b1c8c512d52058b3c26', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14be8f8b-de0c-4029-a83f-c66e4cebc518', 'created_at': datetime.datetime(2026, 7, 3, 11, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14be8f8b-de0c-4029-a83f-c66e4cebc518/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b083bbe4-306e-4194-aa77-db8ac888e1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:22 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Volume volume-ea233894-ff7c-4077-84ed-14630fac3484 (ea233894-ff7c-4077-84ed-14630fac3484): created successfully Jul 03 14:10:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b083bbe4-306e-4194-aa77-db8ac888e1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Flow 'volume_create_manager' (0f2f2c45-569c-48d0-86d0-34a32fd15118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:22 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-06fe1ffa-6ef3-4e32-b788-1d0f455fad7e tempest-TestShelveInstance-1747886666 None] Created volume successfully. Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Flow 'volume_create_manager' (cbbd4ca4-c985-401b-995c-835cbfe57516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dabeecc-4548-42c4-ba0d-a52396785306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dabeecc-4548-42c4-ba0d-a52396785306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-421637988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5afcd702-d66c-4b4a-96df-f0f366b97362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364872770abf486b937dd13003e33e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:25Z,use_quota=True,user_id='cbfa27687d6d405280c98fb56d5345f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (458316d9-d062-4ce3-b709-955395a9664f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (458316d9-d062-4ce3-b709-955395a9664f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e317dfd-9c35-4502-a2d7-04e158b2f33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e317dfd-9c35-4502-a2d7-04e158b2f33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5afcd702-d66c-4b4a-96df-f0f366b97362', 'volume_name': 'volume-5afcd702-d66c-4b4a-96df-f0f366b97362', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860c0d55-c8b4-4c54-ac97-ad14e44936d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860c0d55-c8b4-4c54-ac97-ad14e44936d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97704ff9-70f7-4377-918b-9260101de78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:24 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Volume 5afcd702-d66c-4b4a-96df-f0f366b97362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5afcd702-d66c-4b4a-96df-f0f366b97362', 'volume_size': 1} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-421637988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5afcd702-d66c-4b4a-96df-f0f366b97362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364872770abf486b937dd13003e33e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:25Z,use_quota=True,user_id='cbfa27687d6d405280c98fb56d5345f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Creating volume 5afcd702-d66c-4b4a-96df-f0f366b97362 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:10:24 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:10:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5afcd702-d66c-4b4a-96df-f0f366b97362 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:24 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5afcd702-d66c-4b4a-96df-f0f366b97362 1073741824 Jul 03 14:10:24 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:25 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:10:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Flow 'volume_create_manager' (dec14fce-345e-49a3-bf5c-d8ad807018eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ab9037-40de-4134-aae2-7e19f1373746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ab9037-40de-4134-aae2-7e19f1373746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1457822981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b06a9ea-52a0-4592-8fbf-ee87f7268710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364872770abf486b937dd13003e33e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:25Z,use_quota=True,user_id='cbfa27687d6d405280c98fb56d5345f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07cd139-4379-49b3-8616-5bf781cb5fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07cd139-4379-49b3-8616-5bf781cb5fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201b45fb-26b8-4968-b0d4-5cd7ccbda0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201b45fb-26b8-4968-b0d4-5cd7ccbda0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b06a9ea-52a0-4592-8fbf-ee87f7268710', 'volume_name': 'volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52da074-ba50-407b-a02a-96d6d964ef2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52da074-ba50-407b-a02a-96d6d964ef2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08fe1f17-e3c2-44b5-a17a-207ad809f629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:25 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Volume 0b06a9ea-52a0-4592-8fbf-ee87f7268710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710', 'volume_size': 1} Jul 03 14:10:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:25 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5afcd702-d66c-4b4a-96df-f0f366b97362 1073741824" returned: 0 in 1.091s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5afcd702-d66c-4b4a-96df-f0f366b97362 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:25 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5afcd702-d66c-4b4a-96df-f0f366b97362 Jul 03 14:10:25 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:26 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5afcd702-d66c-4b4a-96df-f0f366b97362" returned: 0 in 0.662s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:10:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.386s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1457822981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b06a9ea-52a0-4592-8fbf-ee87f7268710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364872770abf486b937dd13003e33e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:25Z,use_quota=True,user_id='cbfa27687d6d405280c98fb56d5345f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:10:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Creating volume 0b06a9ea-52a0-4592-8fbf-ee87f7268710 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:10:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:10:26 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:10:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:26 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710 1073741824 Jul 03 14:10:26 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97704ff9-70f7-4377-918b-9260101de78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5afcd702-d66c-4b4a-96df-f0f366b97362', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f0b801-e3a6-41fe-ae4f-b59bdb5a7c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:26 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Volume volume-5afcd702-d66c-4b4a-96df-f0f366b97362 (5afcd702-d66c-4b4a-96df-f0f366b97362): created successfully Jul 03 14:10:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f0b801-e3a6-41fe-ae4f-b59bdb5a7c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Flow 'volume_create_manager' (cbbd4ca4-c985-401b-995c-835cbfe57516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:26 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-c1c44256-48c6-438c-91ea-d559f2139bd5 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Created volume successfully. Jul 03 14:10:27 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710 1073741824" returned: 0 in 0.874s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:27 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710 Jul 03 14:10:27 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:28 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710" returned: 0 in 0.698s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:10:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08fe1f17-e3c2-44b5-a17a-207ad809f629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d6bc9a-46d3-4167-81ae-74abc51792b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:28 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Volume volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710 (0b06a9ea-52a0-4592-8fbf-ee87f7268710): created successfully Jul 03 14:10:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d6bc9a-46d3-4167-81ae-74abc51792b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Flow 'volume_create_manager' (dec14fce-345e-49a3-bf5c-d8ad807018eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f7b86b47-9bf9-4c3e-9e2f-d2055fa63a72 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Created volume successfully. Jul 03 14:10:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-79167510-b15f-41dd-b09e-1ec400fd2183 req-cd723b05-bb52-4f4e-bc13-d489e1e98443 tempest-TestShelveInstance-1747886666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-79167510-b15f-41dd-b09e-1ec400fd2183 req-cd723b05-bb52-4f4e-bc13-d489e1e98443 tempest-TestShelveInstance-1747886666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:31 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cda70b-e1ce-40d0-a13e-41f3d5d980f3]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-79167510-b15f-41dd-b09e-1ec400fd2183 req-cd723b05-bb52-4f4e-bc13-d489e1e98443 tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:31 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 Jul 03 14:10:31 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:32 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-79167510-b15f-41dd-b09e-1ec400fd2183 req-cd723b05-bb52-4f4e-bc13-d489e1e98443 tempest-TestShelveInstance-1747886666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484" returned: 0 in 0.862s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-79167510-b15f-41dd-b09e-1ec400fd2183 req-cd723b05-bb52-4f4e-bc13-d489e1e98443 tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:32 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 Jul 03 14:10:32 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:33 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-79167510-b15f-41dd-b09e-1ec400fd2183 req-cd723b05-bb52-4f4e-bc13-d489e1e98443 tempest-TestShelveInstance-1747886666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484" returned: 1 in 0.881s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-79167510-b15f-41dd-b09e-1ec400fd2183 req-cd723b05-bb52-4f4e-bc13-d489e1e98443 tempest-TestShelveInstance-1747886666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:10:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-79167510-b15f-41dd-b09e-1ec400fd2183 req-cd723b05-bb52-4f4e-bc13-d489e1e98443 tempest-TestShelveInstance-1747886666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.805s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:33 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-79167510-b15f-41dd-b09e-1ec400fd2183 req-cd723b05-bb52-4f4e-bc13-d489e1e98443 tempest-TestShelveInstance-1747886666 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-ea233894-ff7c-4077-84ed-14630fac3484', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09b9ecc8-5dac-4db5-8d7c-fd63bc285133', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:10:33 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-79167510-b15f-41dd-b09e-1ec400fd2183 req-cd723b05-bb52-4f4e-bc13-d489e1e98443 tempest-TestShelveInstance-1747886666 None] attachment_update completed successfully. Jul 03 14:10:43 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=23,cinder:INSERT=16,cinder:SELECT=28,cinder:DELETE=1 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:10:43 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=30,cinder:UPDATE=22,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:10:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:10:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:58 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:10:58 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:59 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.618s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:11:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-71b3abef-e5a4-4c23-ab03-4879addf5d44 req-e0889276-414c-4096-bbf6-f7233db3c14f tempest-TestServerVolumeAttachmentScenario-1774401973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:11:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-71b3abef-e5a4-4c23-ab03-4879addf5d44 req-e0889276-414c-4096-bbf6-f7233db3c14f tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:11:08 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[796da221-c9e5-4813-94a2-f8fc9b9a9007]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:11:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-71b3abef-e5a4-4c23-ab03-4879addf5d44 req-e0889276-414c-4096-bbf6-f7233db3c14f tempest-TestServerVolumeAttachmentScenario-1774401973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5afcd702-d66c-4b4a-96df-f0f366b97362 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:11:08 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5afcd702-d66c-4b4a-96df-f0f366b97362 Jul 03 14:11:08 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:11:09 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Jul 03 14:11:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-71b3abef-e5a4-4c23-ab03-4879addf5d44 req-e0889276-414c-4096-bbf6-f7233db3c14f tempest-TestServerVolumeAttachmentScenario-1774401973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5afcd702-d66c-4b4a-96df-f0f366b97362" returned: 0 in 0.757s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:11:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-71b3abef-e5a4-4c23-ab03-4879addf5d44 req-e0889276-414c-4096-bbf6-f7233db3c14f tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.774s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:11:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-71b3abef-e5a4-4c23-ab03-4879addf5d44 req-e0889276-414c-4096-bbf6-f7233db3c14f tempest-TestServerVolumeAttachmentScenario-1774401973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-5afcd702-d66c-4b4a-96df-f0f366b97362', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c51a9f8-bd5e-4448-ba78-38d32e38f52a', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:11:09 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-71b3abef-e5a4-4c23-ab03-4879addf5d44 req-e0889276-414c-4096-bbf6-f7233db3c14f tempest-TestServerVolumeAttachmentScenario-1774401973 None] attachment_update completed successfully. Jul 03 14:11:11 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-116d3d6b-ad94-433e-b926-aaa8b0dc137d req-0b4f2995-9ade-4999-a4c9-6c94ab13fee6 tempest-TestShelveInstance-1747886666 None] Terminate volume connection completed successfully. Jul 03 14:11:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-116d3d6b-ad94-433e-b926-aaa8b0dc137d req-0b4f2995-9ade-4999-a4c9-6c94ab13fee6 tempest-TestShelveInstance-1747886666 None] Deleting attachment 09b9ecc8-5dac-4db5-8d7c-fd63bc285133. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:11:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-28f88f80-c3fa-4034-9bee-bfb46a6c6e4b req-ad671e12-bd30-4aff-9dbb-483694a79555 tempest-TestShelveInstance-1747886666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:11:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-28f88f80-c3fa-4034-9bee-bfb46a6c6e4b req-ad671e12-bd30-4aff-9dbb-483694a79555 tempest-TestShelveInstance-1747886666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:11:16 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cad53d-b4a2-41de-a8d1-201cbba2ad52]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:11:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-28f88f80-c3fa-4034-9bee-bfb46a6c6e4b req-ad671e12-bd30-4aff-9dbb-483694a79555 tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:11:16 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 Jul 03 14:11:16 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:11:16 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Jul 03 14:11:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-28f88f80-c3fa-4034-9bee-bfb46a6c6e4b req-ad671e12-bd30-4aff-9dbb-483694a79555 tempest-TestShelveInstance-1747886666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484" returned: 0 in 0.718s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:11:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-28f88f80-c3fa-4034-9bee-bfb46a6c6e4b req-ad671e12-bd30-4aff-9dbb-483694a79555 tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:11:16 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 Jul 03 14:11:16 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:11:17 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Jul 03 14:11:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-28f88f80-c3fa-4034-9bee-bfb46a6c6e4b req-ad671e12-bd30-4aff-9dbb-483694a79555 tempest-TestShelveInstance-1747886666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484" returned: 1 in 0.771s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:11:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-28f88f80-c3fa-4034-9bee-bfb46a6c6e4b req-ad671e12-bd30-4aff-9dbb-483694a79555 tempest-TestShelveInstance-1747886666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:11:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-28f88f80-c3fa-4034-9bee-bfb46a6c6e4b req-ad671e12-bd30-4aff-9dbb-483694a79555 tempest-TestShelveInstance-1747886666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.536s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:11:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-28f88f80-c3fa-4034-9bee-bfb46a6c6e4b req-ad671e12-bd30-4aff-9dbb-483694a79555 tempest-TestShelveInstance-1747886666 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-ea233894-ff7c-4077-84ed-14630fac3484', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77e66eef-abbf-418d-ab82-2a4260a079c8', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:11:17 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-28f88f80-c3fa-4034-9bee-bfb46a6c6e4b req-ad671e12-bd30-4aff-9dbb-483694a79555 tempest-TestShelveInstance-1747886666 None] attachment_update completed successfully. Jul 03 14:11:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-6cbcf6fe-86da-43c3-91d5-d5f3762995bf req-84a54119-d1b4-4f86-927e-71e51bb9659c tempest-TestServerVolumeAttachmentScenario-1774401973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:11:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-6cbcf6fe-86da-43c3-91d5-d5f3762995bf req-84a54119-d1b4-4f86-927e-71e51bb9659c tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:11:18 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[414d376a-9159-4544-ae04-2031b495b6c0]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:11:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-6cbcf6fe-86da-43c3-91d5-d5f3762995bf req-84a54119-d1b4-4f86-927e-71e51bb9659c tempest-TestServerVolumeAttachmentScenario-1774401973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:11:18 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710 Jul 03 14:11:18 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:11:19 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Jul 03 14:11:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-6cbcf6fe-86da-43c3-91d5-d5f3762995bf req-84a54119-d1b4-4f86-927e-71e51bb9659c tempest-TestServerVolumeAttachmentScenario-1774401973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710" returned: 0 in 0.773s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:11:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-6cbcf6fe-86da-43c3-91d5-d5f3762995bf req-84a54119-d1b4-4f86-927e-71e51bb9659c tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.797s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:11:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-6cbcf6fe-86da-43c3-91d5-d5f3762995bf req-84a54119-d1b4-4f86-927e-71e51bb9659c tempest-TestServerVolumeAttachmentScenario-1774401973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '910b7acf-cde2-4396-a52c-0370b6d085ea', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:11:19 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-6cbcf6fe-86da-43c3-91d5-d5f3762995bf req-84a54119-d1b4-4f86-927e-71e51bb9659c tempest-TestServerVolumeAttachmentScenario-1774401973 None] attachment_update completed successfully. Jul 03 14:11:25 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-f2389bec-7c13-400c-a843-10ac8cd1e1ae req-c421fd6c-3a00-43ae-949c-0b946480adb2 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Terminate volume connection completed successfully. Jul 03 14:11:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-f2389bec-7c13-400c-a843-10ac8cd1e1ae req-c421fd6c-3a00-43ae-949c-0b946480adb2 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Deleting attachment 910b7acf-cde2-4396-a52c-0370b6d085ea. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:11:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-ccabdbe1-6859-4d71-83f2-18b3ccd682d9 req-5200dfb2-8021-490d-a829-1d688640191c tempest-TestServerVolumeAttachmentScenario-1774401973 None] Terminate volume connection completed successfully. Jul 03 14:11:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-ccabdbe1-6859-4d71-83f2-18b3ccd682d9 req-5200dfb2-8021-490d-a829-1d688640191c tempest-TestServerVolumeAttachmentScenario-1774401973 None] Deleting attachment 5c51a9f8-bd5e-4448-ba78-38d32e38f52a. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:11:35 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=19,cinder:UPDATE=6 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:11:38 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=20,cinder:UPDATE=3 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:11:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Acquiring lock "cinder-0b06a9ea-52a0-4592-8fbf-ee87f7268710-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:11:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "cinder-0b06a9ea-52a0-4592-8fbf-ee87f7268710-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:11:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Acquiring lock "cinder-quobyte-0b06a9ea-52a0-4592-8fbf-ee87f7268710" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:11:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "cinder-quobyte-0b06a9ea-52a0-4592-8fbf-ee87f7268710" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:11:39 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba259fe-cd98-4564-9a2b-86708f360332]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:11:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:11:39 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710 Jul 03 14:11:39 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:11:40 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Jul 03 14:11:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710" returned: 0 in 0.754s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:11:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:11:40 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710 Jul 03 14:11:40 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:11:40 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Jul 03 14:11:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0b06a9ea-52a0-4592-8fbf-ee87f7268710" returned: 0 in 0.646s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:11:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "cinder-quobyte-0b06a9ea-52a0-4592-8fbf-ee87f7268710" released by "delete_volume" :: held 1.443s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:11:40 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Created reservations ['8d8b2484-a307-4e26-a794-a8fe82d745fb', 'cc9effc1-5bc1-4878-a8da-e38e374e57ed', '11e47428-9c86-4994-b83c-941b09980f8e', '7dbcbed2-5d00-4e6e-9d96-101dd7906454'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:11:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:11:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:11:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:11:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:11:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:11:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:11:41 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:11:41 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:11:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] Acquiring lock "cinder-5afcd702-d66c-4b4a-96df-f0f366b97362-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:11:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "cinder-5afcd702-d66c-4b4a-96df-f0f366b97362-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:11:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] Acquiring lock "cinder-quobyte-5afcd702-d66c-4b4a-96df-f0f366b97362" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:11:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "cinder-quobyte-5afcd702-d66c-4b4a-96df-f0f366b97362" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:11:41 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Jul 03 14:11:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.705s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:11:41 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:11:41 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Deleted volume successfully. Jul 03 14:11:41 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c60e6b2-4622-4040-9754-6180bd0379d5]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:11:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5afcd702-d66c-4b4a-96df-f0f366b97362 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:11:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d0715d52-9a75-4543-93a6-d8aeb54f8c56 tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "cinder-0b06a9ea-52a0-4592-8fbf-ee87f7268710-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:11:41 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5afcd702-d66c-4b4a-96df-f0f366b97362 Jul 03 14:11:41 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:11:42 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Jul 03 14:11:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5afcd702-d66c-4b4a-96df-f0f366b97362" returned: 0 in 0.766s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:11:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5afcd702-d66c-4b4a-96df-f0f366b97362 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:11:42 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5afcd702-d66c-4b4a-96df-f0f366b97362 Jul 03 14:11:42 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:11:43 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Jul 03 14:11:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5afcd702-d66c-4b4a-96df-f0f366b97362" returned: 0 in 0.685s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:11:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "cinder-quobyte-5afcd702-d66c-4b4a-96df-f0f366b97362" released by "delete_volume" :: held 1.504s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:11:43 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] Created reservations ['63a8c8bf-230d-4edd-a8f8-ca536654c61e', '88a4e74e-61fe-4514-b812-6438a4478039', '504eef63-2017-447b-a577-42f994966073', 'bf6ec94c-d2b2-4b47-b4b7-aa7fc6cbd9b1'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:11:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:11:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:11:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:11:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:11:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:11:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:11:43 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:11:43 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:11:44 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Jul 03 14:11:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.706s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:11:44 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:11:44 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] Deleted volume successfully. Jul 03 14:11:44 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ba091760-5116-4676-a645-5bbc6883cd9d tempest-TestServerVolumeAttachmentScenario-1774401973 None] Lock "cinder-5afcd702-d66c-4b4a-96df-f0f366b97362-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:11:53 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=13,cinder:INSERT=2,cinder:UPDATE=14 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:11:54 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=18,cinder:SELECT=7,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:11:57 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:11:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Flow 'volume_create_manager' (47af67be-c309-4f52-8cf5-3198459d94a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:11:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c1a657-9062-44df-839d-79e551e7bbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:11:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c1a657-9062-44df-839d-79e551e7bbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a2a95c-7725-463f-8903-1e42e99cfdb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0081d949ecc449c8951bd6b2d39864ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:11:57Z,use_quota=True,user_id='e33c790d35e34c6099d6b678eb639590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a778969-17f1-48e6-8c52-5aa66e6011b2),volume_type_id=2a778969-17f1-48e6-8c52-5aa66e6011b2)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:11:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421648a8-f314-40cd-bc9f-c3193516d87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:11:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421648a8-f314-40cd-bc9f-c3193516d87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:11:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d49002-a5df-402b-b56e-f10134468afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:11:57 devstack cinder-volume[86805]: DEBUG cinder.image.glance [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Creating Keystone auth plugin from conf {{(pid=86805) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 14:11:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d49002-a5df-402b-b56e-f10134468afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '80a2a95c-7725-463f-8903-1e42e99cfdb2', 'volume_name': 'volume-80a2a95c-7725-463f-8903-1e42e99cfdb2', 'volume_size': 1, 'image_id': '1a38e764-16ca-4f2f-8623-9123784bec53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a38e764-16ca-4f2f-8623-9123784bec53', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf1b498637845fb6d0d5b352c9904a19', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0081d949ecc449c8951bd6b2d39864ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8aecd0fe341219090cad26ad8258c033c6be7e0081cf56aa408f4170674bd4d3dbbd3df73c6b1f55896b68f480ae285d34687733676850483d35006b50a668cb', 'id': '1a38e764-16ca-4f2f-8623-9123784bec53', 'created_at': datetime.datetime(2026, 7, 3, 12, 11, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a38e764-16ca-4f2f-8623-9123784bec53/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:11:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d4adae-cd68-4510-b586-52ac6affeeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:11:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d4adae-cd68-4510-b586-52ac6affeeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:11:57 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874f7bff-19b4-414a-93aa-1ecd4225926a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:11:57 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Volume 80a2a95c-7725-463f-8903-1e42e99cfdb2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-80a2a95c-7725-463f-8903-1e42e99cfdb2', 'volume_size': 1, 'image_id': '1a38e764-16ca-4f2f-8623-9123784bec53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a38e764-16ca-4f2f-8623-9123784bec53', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf1b498637845fb6d0d5b352c9904a19', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0081d949ecc449c8951bd6b2d39864ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8aecd0fe341219090cad26ad8258c033c6be7e0081cf56aa408f4170674bd4d3dbbd3df73c6b1f55896b68f480ae285d34687733676850483d35006b50a668cb', 'id': '1a38e764-16ca-4f2f-8623-9123784bec53', 'created_at': datetime.datetime(2026, 7, 3, 12, 11, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a38e764-16ca-4f2f-8623-9123784bec53/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 03 14:11:57 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Trying to clone 80a2a95c-7725-463f-8903-1e42e99cfdb2 from image 1a38e764-16ca-4f2f-8623-9123784bec53 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1a38e764-16ca-4f2f-8623-9123784bec53', 'metadata': {}}]). {{(pid=86805) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 14:11:57 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 14:11:57 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Image download 0.00 MB at 0.00 MB/s Jul 03 14:11:57 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dcbdfc-bf8d-4cde-b9b6-f42d2a5af0a9]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:11:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:11:57 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD Jul 03 14:11:57 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:11:58 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Jul 03 14:11:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD" returned: 0 in 0.737s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:11:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:11:58 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD Jul 03 14:11:58 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:11:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:11:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:11:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:11:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:11:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:11:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:11:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:11:58 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:11:58 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:11:58 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Jul 03 14:11:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD" returned: 1 in 0.704s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:11:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:11:58 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Temporary image 1a38e764-16ca-4f2f-8623-9123784bec53 is fetched for user e33c790d35e34c6099d6b678eb639590. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 14:11:58 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba68ab8d-3dcd-45f3-b5fc-126d2705f263]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:11:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:11:59 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Jul 03 14:11:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.654s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:11:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:11:59 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD Jul 03 14:11:59 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:11:59 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Jul 03 14:11:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD" returned: 0 in 0.692s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:11:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:11:59 devstack sudo[103792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD Jul 03 14:11:59 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:00 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD" returned: 1 in 0.729s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:12:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:12:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:12:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a2a95c-7725-463f-8903-1e42e99cfdb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0081d949ecc449c8951bd6b2d39864ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:11:57Z,use_quota=True,user_id='e33c790d35e34c6099d6b678eb639590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a778969-17f1-48e6-8c52-5aa66e6011b2),volume_type_id=2a778969-17f1-48e6-8c52-5aa66e6011b2)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:12:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Creating volume 80a2a95c-7725-463f-8903-1e42e99cfdb2 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:12:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:12:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:12:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:12:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:12:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:12:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:12:00 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:12:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:00 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 1073741824 Jul 03 14:12:00 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:01 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 1073741824" returned: 0 in 0.844s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:01 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 Jul 03 14:12:01 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:02 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2" returned: 0 in 0.731s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:12:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:12:02 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Attempting download of 1a38e764-16ca-4f2f-8623-9123784bec53 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a38e764-16ca-4f2f-8623-9123784bec53', 'metadata': {}}])) to volume 80a2a95c-7725-463f-8903-1e42e99cfdb2. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 14:12:02 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af11f62-82ca-4ae9-b892-8627b1daa798]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:12:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a38e764-16ca-4f2f-8623-9123784bec53_00_t_m_l {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:02 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a38e764-16ca-4f2f-8623-9123784bec53_00_t_m_l Jul 03 14:12:02 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:02 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a38e764-16ca-4f2f-8623-9123784bec53_00_t_m_l" returned: 0 in 0.804s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a38e764-16ca-4f2f-8623-9123784bec53_00_t_m_l {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:03 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a38e764-16ca-4f2f-8623-9123784bec53_00_t_m_l Jul 03 14:12:03 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:03 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a38e764-16ca-4f2f-8623-9123784bec53_00_t_m_l" returned: 1 in 0.709s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a38e764-16ca-4f2f-8623-9123784bec53_00_t_m_l' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:12:03 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8902de6d-aeb9-49e1-b6ca-0c4e3128f3de]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:12:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:03 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD Jul 03 14:12:03 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:04 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD" returned: 0 in 0.740s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:04 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD Jul 03 14:12:04 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:05 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD" returned: 1 in 0.730s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:12:05 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] 1a38e764-16ca-4f2f-8623-9123784bec53 was raw, converting to raw {{(pid=86805) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 14:12:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:05 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 Jul 03 14:12:05 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:05 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2" returned: 0 in 0.768s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:05 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1a38e764-16ca-4f2f-8623-9123784bec53_tjt9c5fbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:12:05 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 14:12:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:05 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 1G Jul 03 14:12:05 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:06 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 1G" returned: 0 in 0.828s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:06 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0664ac5a-53b2-41c5-b90f-5ff29ab1ed31]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:12:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:06 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 Jul 03 14:12:06 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:07 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2" returned: 0 in 0.841s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:07 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 Jul 03 14:12:07 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:08 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2" returned: 1 in 0.857s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:12:08 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Downloaded image 1a38e764-16ca-4f2f-8623-9123784bec53 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a38e764-16ca-4f2f-8623-9123784bec53', 'metadata': {}}])) to volume 80a2a95c-7725-463f-8903-1e42e99cfdb2 successfully. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 14:12:08 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Temporary image 1a38e764-16ca-4f2f-8623-9123784bec53 for user e33c790d35e34c6099d6b678eb639590 is deleted. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 14:12:08 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Marking volume 80a2a95c-7725-463f-8903-1e42e99cfdb2 as bootable. {{(pid=86805) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 14:12:08 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Copying metadata from image 1a38e764-16ca-4f2f-8623-9123784bec53 to 80a2a95c-7725-463f-8903-1e42e99cfdb2. {{(pid=86805) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 14:12:08 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Creating volume glance metadata for volume 80a2a95c-7725-463f-8903-1e42e99cfdb2 backed by image 1a38e764-16ca-4f2f-8623-9123784bec53 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1a38e764-16ca-4f2f-8623-9123784bec53', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cf1b498637845fb6d0d5b352c9904a19', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86805) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 14:12:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874f7bff-19b4-414a-93aa-1ecd4225926a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a2a95c-7725-463f-8903-1e42e99cfdb2', 'volume_size': 1, 'image_id': '1a38e764-16ca-4f2f-8623-9123784bec53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a38e764-16ca-4f2f-8623-9123784bec53', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf1b498637845fb6d0d5b352c9904a19', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0081d949ecc449c8951bd6b2d39864ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8aecd0fe341219090cad26ad8258c033c6be7e0081cf56aa408f4170674bd4d3dbbd3df73c6b1f55896b68f480ae285d34687733676850483d35006b50a668cb', 'id': '1a38e764-16ca-4f2f-8623-9123784bec53', 'created_at': datetime.datetime(2026, 7, 3, 12, 11, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a38e764-16ca-4f2f-8623-9123784bec53/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:12:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ec4fa4-478b-48dc-bafe-17fc33479fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:12:08 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Volume volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 (80a2a95c-7725-463f-8903-1e42e99cfdb2): created successfully Jul 03 14:12:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ec4fa4-478b-48dc-bafe-17fc33479fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:12:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Flow 'volume_create_manager' (47af67be-c309-4f52-8cf5-3198459d94a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:12:08 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-d8ad9105-e49a-4403-9245-8b204a31c8c6 tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Created volume successfully. Jul 03 14:12:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Acquiring lock "cinder-80a2a95c-7725-463f-8903-1e42e99cfdb2-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:12:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Lock "cinder-80a2a95c-7725-463f-8903-1e42e99cfdb2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:12:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Acquiring lock "cinder-quobyte-80a2a95c-7725-463f-8903-1e42e99cfdb2" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:12:08 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Lock "cinder-quobyte-80a2a95c-7725-463f-8903-1e42e99cfdb2" acquired by "delete_volume" :: waited 0.021s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:12:08 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b418efad-853c-4260-bbdc-369d123ef950]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:12:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:09 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 Jul 03 14:12:09 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:09 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2" returned: 0 in 0.751s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:09 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 Jul 03 14:12:09 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:10 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2" returned: 1 in 0.776s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:12:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:10 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2 Jul 03 14:12:10 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:11 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-dda54ac6-008b-4aca-ac98-0fbda2324b97 tempest-TestShelveInstance-1747886666 None] Terminate volume connection completed successfully. Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-dda54ac6-008b-4aca-ac98-0fbda2324b97 tempest-TestShelveInstance-1747886666 None] Deleting attachment 77e66eef-abbf-418d-ab82-2a4260a079c8. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:12:11 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-80a2a95c-7725-463f-8903-1e42e99cfdb2" returned: 0 in 0.632s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Lock "cinder-quobyte-80a2a95c-7725-463f-8903-1e42e99cfdb2" released by "delete_volume" :: held 2.281s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:12:11 devstack cinder-volume[86805]: WARNING cinder.quota [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:12:11 devstack cinder-volume[86805]: WARNING cinder.quota [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Created reservations ['2ffd8545-d018-45ce-8f92-7072a21f1d65', '132f57fe-a34d-46cf-b401-87c38c8a61ba', '9d41758b-47dd-4601-9a55-b19026d46c03', '8a3edcf0-6ea4-4ed4-9f18-074af38937c6'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:11 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:12:11 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Acquiring lock "cinder-ea233894-ff7c-4077-84ed-14630fac3484-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Lock "cinder-ea233894-ff7c-4077-84ed-14630fac3484-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Acquiring lock "cinder-quobyte-ea233894-ff7c-4077-84ed-14630fac3484" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Lock "cinder-quobyte-ea233894-ff7c-4077-84ed-14630fac3484" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[759d18ff-470f-43dc-bc72-9dd4e6bdde71]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:11 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:11 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.635s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:11 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:12:11 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Deleted volume successfully. Jul 03 14:12:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-67aa62ca-5768-4155-b5ca-7ec27e280d2b tempest-VolumeAndVolumeTypeFromImageTest-47087896 None] Lock "cinder-80a2a95c-7725-463f-8903-1e42e99cfdb2-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:12:12 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484" returned: 0 in 0.759s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:12 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 Jul 03 14:12:12 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:13 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484" returned: 1 in 0.766s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:12:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:13 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484 Jul 03 14:12:13 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:14 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ea233894-ff7c-4077-84ed-14630fac3484" returned: 0 in 0.724s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:14 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Lock "cinder-quobyte-ea233894-ff7c-4077-84ed-14630fac3484" released by "delete_volume" :: held 2.310s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:12:14 devstack cinder-volume[86805]: DEBUG cinder.quota [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Created reservations ['87389bcf-6f52-49c9-97df-bc2a05811cce', 'f1f976e8-4e12-45f1-a642-43dd7f1b1267', '14d38d30-4144-489d-bf2d-d26ca02e9412', '34c2db5f-52c3-498c-90e9-5b3924c044f9'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:12:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:12:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:12:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:12:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:12:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:12:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:14 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:12:14 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:14 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.786s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:14 devstack cinder-volume[86805]: DEBUG cinder.manager [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:12:14 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Deleted volume successfully. Jul 03 14:12:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [req-152859e5-9793-45bb-93f3-be8cad8398b1 req-ffc4a7a2-483c-43d3-831d-6c7a477db7c3 tempest-TestShelveInstance-1747886666 None] Lock "cinder-ea233894-ff7c-4077-84ed-14630fac3484-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:12:24 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=21,cinder:SELECT=22,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:12:24 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=17,cinder:UPDATE=21,cinder:INSERT=12,cinder:DELETE=2 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Flow 'volume_create_manager' (d18bda34-4c06-4e7c-a9fc-af047994e145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8487934f-0223-4ec4-86dc-874bc75d133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8487934f-0223-4ec4-86dc-874bc75d133d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1891649927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ba65b0-521b-4a47-afb2-816c841d3191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5761316de27f4115a1a1c5f7b2ce6bc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:12:47Z,use_quota=True,user_id='d02d6de55d8e41ad88f560c2a4307fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94ae29f-df9b-409d-a8be-030bbec1d039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94ae29f-df9b-409d-a8be-030bbec1d039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a63bae7-4017-4fa8-904d-b732efc2d9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a63bae7-4017-4fa8-904d-b732efc2d9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5ba65b0-521b-4a47-afb2-816c841d3191', 'volume_name': 'volume-e5ba65b0-521b-4a47-afb2-816c841d3191', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e27b3d0-f878-4e75-8baa-f52e95ff1dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e27b3d0-f878-4e75-8baa-f52e95ff1dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef89e7e-a361-4dfd-9a45-a0e1ade391a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:12:47 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Volume e5ba65b0-521b-4a47-afb2-816c841d3191: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5ba65b0-521b-4a47-afb2-816c841d3191', 'volume_size': 1} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1891649927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ba65b0-521b-4a47-afb2-816c841d3191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5761316de27f4115a1a1c5f7b2ce6bc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:12:47Z,use_quota=True,user_id='d02d6de55d8e41ad88f560c2a4307fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Creating volume e5ba65b0-521b-4a47-afb2-816c841d3191 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:12:47 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:12:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:47 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 1073741824 Jul 03 14:12:47 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:48 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 1073741824" returned: 0 in 0.903s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:48 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 Jul 03 14:12:48 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:48 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191" returned: 0 in 0.631s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:48 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:12:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:12:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef89e7e-a361-4dfd-9a45-a0e1ade391a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5ba65b0-521b-4a47-afb2-816c841d3191', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:12:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e24175b-10af-492f-9cad-0408fd2e5c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:12:48 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Volume volume-e5ba65b0-521b-4a47-afb2-816c841d3191 (e5ba65b0-521b-4a47-afb2-816c841d3191): created successfully Jul 03 14:12:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e24175b-10af-492f-9cad-0408fd2e5c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:12:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Flow 'volume_create_manager' (d18bda34-4c06-4e7c-a9fc-af047994e145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:12:48 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-7365531f-b348-41cc-a01c-969e9e35748a tempest-TestStampPattern-377369604 None] Created volume successfully. Jul 03 14:12:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:12:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:12:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:12:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:12:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:12:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:12:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:58 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:12:58 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:58 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:12:58 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:12:59 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.839s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:13:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-5b4a0d17-2403-40b3-bc16-5a27a5aee166 req-3c9d73dc-6fd2-48b9-b8af-7aa07aad3353 tempest-TestStampPattern-377369604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:13:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-5b4a0d17-2403-40b3-bc16-5a27a5aee166 req-3c9d73dc-6fd2-48b9-b8af-7aa07aad3353 tempest-TestStampPattern-377369604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:13:27 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0267ace2-22c0-46a7-9913-739a2d647c8e]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:13:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-5b4a0d17-2403-40b3-bc16-5a27a5aee166 req-3c9d73dc-6fd2-48b9-b8af-7aa07aad3353 tempest-TestStampPattern-377369604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:27 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 Jul 03 14:13:27 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:13:28 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Jul 03 14:13:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-5b4a0d17-2403-40b3-bc16-5a27a5aee166 req-3c9d73dc-6fd2-48b9-b8af-7aa07aad3353 tempest-TestStampPattern-377369604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191" returned: 0 in 0.732s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:13:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-5b4a0d17-2403-40b3-bc16-5a27a5aee166 req-3c9d73dc-6fd2-48b9-b8af-7aa07aad3353 tempest-TestStampPattern-377369604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.749s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:13:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-5b4a0d17-2403-40b3-bc16-5a27a5aee166 req-3c9d73dc-6fd2-48b9-b8af-7aa07aad3353 tempest-TestStampPattern-377369604 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-e5ba65b0-521b-4a47-afb2-816c841d3191', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e162cba-d469-450a-b381-afb87e905c4b', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:13:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-5b4a0d17-2403-40b3-bc16-5a27a5aee166 req-3c9d73dc-6fd2-48b9-b8af-7aa07aad3353 tempest-TestStampPattern-377369604 None] attachment_update completed successfully. Jul 03 14:13:36 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-bfbc1f8b-21e7-48f8-b69f-c8ff7db65fbb req-18d95a9c-ecbb-44f4-9ee2-aa75f4618473 tempest-TestStampPattern-377369604 None] Terminate volume connection completed successfully. Jul 03 14:13:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-bfbc1f8b-21e7-48f8-b69f-c8ff7db65fbb req-18d95a9c-ecbb-44f4-9ee2-aa75f4618473 tempest-TestStampPattern-377369604 None] Deleting attachment 4e162cba-d469-450a-b381-afb87e905c4b. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:13:38 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:13:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:13:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:13:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] Creating offline snapshot 5190b02d-2523-4797-a811-bfaf7aa0e28a of volume e5ba65b0-521b-4a47-afb2-816c841d3191 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:13:38 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[715dc0db-590b-46e4-8e94-e60ba2e2ada8]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:13:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:38 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 Jul 03 14:13:38 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:13:39 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Jul 03 14:13:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191" returned: 0 in 0.735s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:13:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:39 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a 1G Jul 03 14:13:39 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:13:39 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Jul 03 14:13:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a 1G" returned: 0 in 0.776s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:13:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5ba65b0-521b-4a47-afb2-816c841d3191 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:39 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5ba65b0-521b-4a47-afb2-816c841d3191 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a Jul 03 14:13:39 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:13:40 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Jul 03 14:13:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5ba65b0-521b-4a47-afb2-816c841d3191 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a" returned: 0 in 0.711s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:13:40 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a is being set with open permissions: ugo+rw Jul 03 14:13:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:40 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a Jul 03 14:13:40 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:13:41 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Jul 03 14:13:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a" returned: 0 in 0.634s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:13:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:41 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.info Jul 03 14:13:41 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:13:41 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jul 03 14:13:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.info" returned: 0 in 0.621s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:13:41 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.info is being set with open permissions: ugo+rw Jul 03 14:13:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:41 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.info Jul 03 14:13:41 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:13:42 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 03 14:13:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.info" returned: 0 in 0.618s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:13:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.181s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:13:42 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ae865075-7b93-4b3a-8de1-ebd68d6a7867 tempest-TestStampPattern-377369604 None] Create snapshot completed successfully Jul 03 14:13:52 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=5 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:13:52 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Flow 'volume_create_manager' (3b9c3414-7eb7-46e7-ad5a-6ebe2949422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd25314b-2341-478c-82cb-b0c0b9b91e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd25314b-2341-478c-82cb-b0c0b9b91e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1261036821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e2c0ec-9d60-4485-9882-85bea54bdfdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5761316de27f4115a1a1c5f7b2ce6bc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5190b02d-2523-4797-a811-bfaf7aa0e28a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:13:53Z,use_quota=True,user_id='d02d6de55d8e41ad88f560c2a4307fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebca06a2-e42d-4c1d-9244-2ea992c70a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebca06a2-e42d-4c1d-9244-2ea992c70a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f222f2c-56ad-4613-9882-a2748c3f8026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f222f2c-56ad-4613-9882-a2748c3f8026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a7e2c0ec-9d60-4485-9882-85bea54bdfdf', 'volume_name': 'volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf', 'volume_size': 1, 'snapshot_id': '5190b02d-2523-4797-a811-bfaf7aa0e28a'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7100ba6e-33d1-46c1-bd75-f5afe69f2617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7100ba6e-33d1-46c1-bd75-f5afe69f2617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7318f628-c888-4539-9e91-62f92b2b71b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:13:53 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Volume a7e2c0ec-9d60-4485-9882-85bea54bdfdf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf', 'volume_size': 1, 'snapshot_id': '5190b02d-2523-4797-a811-bfaf7aa0e28a'} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Acquiring lock "cinder-quobyte-5190b02d-2523-4797-a811-bfaf7aa0e28a-a7e2c0ec-9d60-4485-9882-85bea54bdfdf" by "_create_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Lock "cinder-quobyte-5190b02d-2523-4797-a811-bfaf7aa0e28a-a7e2c0ec-9d60-4485-9882-85bea54bdfdf" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Creating volume a7e2c0ec-9d60-4485-9882-85bea54bdfdf from snapshot 5190b02d-2523-4797-a811-bfaf7aa0e28a {{(pid=86805) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Acquiring lock "cinder-quobyte-a7e2c0ec-9d60-4485-9882-85bea54bdfdf" by "_copy_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Lock "cinder-quobyte-a7e2c0ec-9d60-4485-9882-85bea54bdfdf" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] snapshot: 5190b02d-2523-4797-a811-bfaf7aa0e28a, volume: a7e2c0ec-9d60-4485-9882-85bea54bdfdf, {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[db88f261-287c-4980-bac6-2af1d8b5b3b5]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:13:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:53 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a Jul 03 14:13:53 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:13:54 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Jul 03 14:13:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a" returned: 0 in 0.752s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:13:54 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5ba65b0-521b-4a47-afb2-816c841d3191(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:13:54 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] will copy from snapshot at /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 14:13:54 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Creating direct copy from snapshot {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 14:13:54 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ace508e-e702-4b8a-a2ac-3f28d6b7dfac]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:13:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:54 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 Jul 03 14:13:54 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:13:55 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Jul 03 14:13:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191" returned: 0 in 0.761s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:13:55 devstack cinder-volume[86805]: DEBUG cinder.utils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Path /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf not found in is_blk_device check {{(pid=86805) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 14:13:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:55 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf Jul 03 14:13:55 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:13:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:13:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:13:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:13:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:13:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:13:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:13:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:58 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:13:58 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:13:59 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jul 03 14:13:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.489s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:13:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:14:00 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf" returned: 0 in 5.398s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:00 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[461b32bb-f67b-4aba-91bc-97c92e308abb]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:00 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 Jul 03 14:14:00 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:01 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191" returned: 0 in 1.135s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:01 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Image conversion details: src /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191, size 1024.00 MB, duration 5.40 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:14:01 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Converted 1024.00 MB image at 189.64 MB/s Jul 03 14:14:01 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf is being set with open permissions: ugo+rw Jul 03 14:14:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:01 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf Jul 03 14:14:01 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:02 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf" returned: 0 in 0.770s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:02 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Lock "cinder-quobyte-a7e2c0ec-9d60-4485-9882-85bea54bdfdf" released by "_copy_volume_from_snapshot" :: held 8.926s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:02 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Lock "cinder-quobyte-5190b02d-2523-4797-a811-bfaf7aa0e28a-a7e2c0ec-9d60-4485-9882-85bea54bdfdf" released by "_create_volume_from_snapshot" :: held 8.955s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.968s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7318f628-c888-4539-9e91-62f92b2b71b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf', 'volume_size': 1, 'snapshot_id': '5190b02d-2523-4797-a811-bfaf7aa0e28a'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0435ff1a-c56b-4d29-94bd-7bc71f959ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:02 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Volume volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf (a7e2c0ec-9d60-4485-9882-85bea54bdfdf): created successfully Jul 03 14:14:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0435ff1a-c56b-4d29-94bd-7bc71f959ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:02 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Flow 'volume_create_manager' (3b9c3414-7eb7-46e7-ad5a-6ebe2949422c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:14:02 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-030ed999-c298-45f1-9196-830c25b4c630 tempest-TestStampPattern-377369604 None] Created volume successfully. Jul 03 14:14:12 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:14:12 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:14:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-58e67483-1f9a-4ca0-9f91-1b1e4ab7f943 req-9a4163fc-3185-43e7-bd47-cc429f7f92e9 tempest-TestStampPattern-377369604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-58e67483-1f9a-4ca0-9f91-1b1e4ab7f943 req-9a4163fc-3185-43e7-bd47-cc429f7f92e9 tempest-TestStampPattern-377369604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:37 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7674a250-12aa-4b93-bb23-3e859c57e570]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-58e67483-1f9a-4ca0-9f91-1b1e4ab7f943 req-9a4163fc-3185-43e7-bd47-cc429f7f92e9 tempest-TestStampPattern-377369604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:37 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf Jul 03 14:14:37 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:38 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [req-58e67483-1f9a-4ca0-9f91-1b1e4ab7f943 req-9a4163fc-3185-43e7-bd47-cc429f7f92e9 tempest-TestStampPattern-377369604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf" returned: 0 in 0.757s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [req-58e67483-1f9a-4ca0-9f91-1b1e4ab7f943 req-9a4163fc-3185-43e7-bd47-cc429f7f92e9 tempest-TestStampPattern-377369604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.775s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-58e67483-1f9a-4ca0-9f91-1b1e4ab7f943 req-9a4163fc-3185-43e7-bd47-cc429f7f92e9 tempest-TestStampPattern-377369604 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28', 'name': 'volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8673c9fb-9f1d-402d-9e8d-7607ec1e3449', 'enforce_multipath': True} {{(pid=86805) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:14:38 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-58e67483-1f9a-4ca0-9f91-1b1e4ab7f943 req-9a4163fc-3185-43e7-bd47-cc429f7f92e9 tempest-TestStampPattern-377369604 None] attachment_update completed successfully. Jul 03 14:14:44 devstack cinder-volume[86805]: INFO cinder.volume.manager [req-2f30bf51-0f5f-4080-bc29-af2c154c7877 req-b8e3ccb4-d7c1-4cae-b842-c6c54aecc352 tempest-TestStampPattern-377369604 None] Terminate volume connection completed successfully. Jul 03 14:14:44 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [req-2f30bf51-0f5f-4080-bc29-af2c154c7877 req-b8e3ccb4-d7c1-4cae-b842-c6c54aecc352 tempest-TestStampPattern-377369604 None] Deleting attachment 8673c9fb-9f1d-402d-9e8d-7607ec1e3449. {{(pid=86805) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:14:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] Acquiring lock "cinder-a7e2c0ec-9d60-4485-9882-85bea54bdfdf-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] Lock "cinder-a7e2c0ec-9d60-4485-9882-85bea54bdfdf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] Acquiring lock "cinder-quobyte-a7e2c0ec-9d60-4485-9882-85bea54bdfdf" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] Lock "cinder-quobyte-a7e2c0ec-9d60-4485-9882-85bea54bdfdf" acquired by "delete_volume" :: waited 0.015s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:53 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b31846-e623-47a0-8654-d11384320668]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:54 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf Jul 03 14:14:54 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:54 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf" returned: 0 in 0.826s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:54 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf Jul 03 14:14:54 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:55 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a7e2c0ec-9d60-4485-9882-85bea54bdfdf" returned: 0 in 0.697s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:55 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] Lock "cinder-quobyte-a7e2c0ec-9d60-4485-9882-85bea54bdfdf" released by "delete_volume" :: held 1.575s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:55 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] Created reservations ['dad14b2c-7f2f-4f58-8be9-5a505f1f3640', '54562686-6cf8-430b-be61-ef3c8518854d', '09b0193d-2e17-4422-bf17-b44b911ae8ab', 'b8813f63-39f9-4e32-b309-30754c70c469'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:14:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:14:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:14:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:55 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:14:55 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:56 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.690s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:56 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:14:56 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] Deleted volume successfully. Jul 03 14:14:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2556f7d4-774b-4c75-83b0-ee437d43ee7e tempest-TestStampPattern-377369604 None] Lock "cinder-a7e2c0ec-9d60-4485-9882-85bea54bdfdf-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] Acquiring lock "cinder-5190b02d-2523-4797-a811-bfaf7aa0e28a-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] Lock "cinder-5190b02d-2523-4797-a811-bfaf7aa0e28a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] Acquiring lock "cinder-quobyte-e5ba65b0-521b-4a47-afb2-816c841d3191" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] Lock "cinder-quobyte-e5ba65b0-521b-4a47-afb2-816c841d3191" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] Acquiring lock "cinder-quobyte-5190b02d-2523-4797-a811-bfaf7aa0e28a" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] Lock "cinder-quobyte-5190b02d-2523-4797-a811-bfaf7aa0e28a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] Deleting offline snapshot 5190b02d-2523-4797-a811-bfaf7aa0e28a of volume e5ba65b0-521b-4a47-afb2-816c841d3191 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:14:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] snapshot_file for this snap is: volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:14:56 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb37ebc-c189-4efe-be82-c5cc0d63810f]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:56 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a Jul 03 14:14:56 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:57 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a" returned: 0 in 0.766s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:57 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5ba65b0-521b-4a47-afb2-816c841d3191(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:14:57 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae87f97-6da1-48a9-91a9-fdfaac05ca3f]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:57 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 Jul 03 14:14:57 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:57 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191" returned: 0 in 0.727s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:57 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a Jul 03 14:14:57 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:14:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:14:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:14:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:58 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:14:58 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:58 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a" returned: 0 in 0.859s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:58 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a Jul 03 14:14:58 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:59 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.672s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:14:59 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191.5190b02d-2523-4797-a811-bfaf7aa0e28a" returned: 0 in 0.681s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] Lock "cinder-quobyte-5190b02d-2523-4797-a811-bfaf7aa0e28a" released by "_delete_snapshot" :: held 3.131s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] Lock "cinder-quobyte-e5ba65b0-521b-4a47-afb2-816c841d3191" released by "delete_snapshot" :: held 3.152s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:59 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] Created reservations ['17733162-c242-421a-8d98-0e8581b82a78', '7e687824-d684-4eec-b414-87b72fef81f9', '20a979d6-dcdd-48d3-9c17-704e0b1cd8a8', 'e14af7cc-26ef-4b9a-8f34-67909efc426a'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:14:59 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] Delete snapshot completed successfully. Jul 03 14:14:59 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-27be3ef8-7290-4a67-82a4-532630d9a28b tempest-TestStampPattern-377369604 None] Lock "cinder-5190b02d-2523-4797-a811-bfaf7aa0e28a-delete_snapshot" released by "delete_snapshot" :: held 3.297s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] Acquiring lock "cinder-e5ba65b0-521b-4a47-afb2-816c841d3191-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] Lock "cinder-e5ba65b0-521b-4a47-afb2-816c841d3191-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] Acquiring lock "cinder-quobyte-e5ba65b0-521b-4a47-afb2-816c841d3191" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:07 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] Lock "cinder-quobyte-e5ba65b0-521b-4a47-afb2-816c841d3191" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:07 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[97168464-7c29-4a0e-8e69-208027d2c144]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:07 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 Jul 03 14:15:07 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:08 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191" returned: 0 in 0.769s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:08 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191 Jul 03 14:15:08 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:09 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e5ba65b0-521b-4a47-afb2-816c841d3191" returned: 0 in 0.716s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] Lock "cinder-quobyte-e5ba65b0-521b-4a47-afb2-816c841d3191" released by "delete_volume" :: held 1.541s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:09 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] Created reservations ['f906d3c3-72c3-44fb-8b03-a8636eb67347', '718b34e0-bef6-45a7-9baf-0e5c53d0bf3d', '94a0cd11-95c8-4224-9498-6cc423ca021e', '49c7835b-23d1-4eb6-8c87-145c96f146ef'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:15:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:09 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:15:09 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:10 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.698s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:10 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:15:10 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] Deleted volume successfully. Jul 03 14:15:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a5bfbd1a-33b8-4139-8124-102e16ad7d11 tempest-TestStampPattern-377369604 None] Lock "cinder-e5ba65b0-521b-4a47-afb2-816c841d3191-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:19 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=20,cinder:UPDATE=24,cinder:INSERT=8 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=24,cinder:UPDATE=22,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Flow 'volume_create_manager' (b8fd9d6c-a015-46c2-92c7-37613fa8a1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071d5ff5-9d0b-46ba-8858-b0b76f279b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071d5ff5-9d0b-46ba-8858-b0b76f279b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1439065349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72ea11d81574e21aea59af691c50309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:15:20Z,use_quota=True,user_id='365c8e5416604834ae3fc0ae91050acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fc5a68-d077-409e-9767-1b4bbfa75c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fc5a68-d077-409e-9767-1b4bbfa75c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57bf9b74-3fe3-4d23-8cdb-20582f449bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57bf9b74-3fe3-4d23-8cdb-20582f449bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116', 'volume_name': 'volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bccffb-c714-4c49-9793-963bfe9b12be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bccffb-c714-4c49-9793-963bfe9b12be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537e9b30-c6ec-4739-90b1-a1fb39cb60b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:20 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume 5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116', 'volume_size': 1} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1439065349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72ea11d81574e21aea59af691c50309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:15:20Z,use_quota=True,user_id='365c8e5416604834ae3fc0ae91050acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Creating volume 5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:15:20 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:15:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:20 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 1073741824 Jul 03 14:15:20 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:21 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 1073741824" returned: 0 in 0.809s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:21 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 Jul 03 14:15:21 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:21 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116" returned: 0 in 0.613s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:15:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537e9b30-c6ec-4739-90b1-a1fb39cb60b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8931b666-0a89-4cbb-8176-2b49a6db0b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:21 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 (5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116): created successfully Jul 03 14:15:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8931b666-0a89-4cbb-8176-2b49a6db0b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:21 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Flow 'volume_create_manager' (b8fd9d6c-a015-46c2-92c7-37613fa8a1bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:15:21 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-77e406b3-178c-4209-a356-798760efcb4a tempest-CreateVolumesFromSnapshotTest-262474861 None] Created volume successfully. Jul 03 14:15:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] Creating offline snapshot e68c9b61-ea6c-481c-8bbc-5ad20f75beaf of volume 5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:15:22 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[779e9fbb-93e1-4982-905d-cf159ff8de9a]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:22 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 Jul 03 14:15:22 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:23 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116" returned: 0 in 0.753s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:23 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf 1G Jul 03 14:15:23 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:24 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf 1G" returned: 0 in 0.760s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:24 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf Jul 03 14:15:24 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:24 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf" returned: 0 in 0.657s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:24 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf is being set with open permissions: ugo+rw Jul 03 14:15:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:24 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf Jul 03 14:15:24 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:25 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf" returned: 0 in 0.635s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:25 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.info Jul 03 14:15:25 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:26 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.info" returned: 0 in 0.606s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:26 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.info is being set with open permissions: ugo+rw Jul 03 14:15:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:26 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.info Jul 03 14:15:26 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:26 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.info" returned: 0 in 0.606s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.102s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:26 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-85d6f167-999b-4b0a-b1ee-c88c8a0f7fe4 tempest-CreateVolumesFromSnapshotTest-262474861 None] Create snapshot completed successfully Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Flow 'volume_create_manager' (b0993cae-51ba-4207-8fbe-9dc6b9c960d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f1cfed-99b1-413a-959e-ecd4d9772011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f1cfed-99b1-413a-959e-ecd4d9772011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-43791748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fec4eeb-4423-424d-989a-e0da8546cbd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72ea11d81574e21aea59af691c50309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:15:28Z,use_quota=True,user_id='365c8e5416604834ae3fc0ae91050acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1cdb289-f2ee-4ad4-a935-208fd1765dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1cdb289-f2ee-4ad4-a935-208fd1765dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a4c739-c722-48a3-9b93-01aef174c3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a4c739-c722-48a3-9b93-01aef174c3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fec4eeb-4423-424d-989a-e0da8546cbd8', 'volume_name': 'volume-8fec4eeb-4423-424d-989a-e0da8546cbd8', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa2c5da-2162-4003-8179-40e0bb4b1f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa2c5da-2162-4003-8179-40e0bb4b1f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a829544-bd53-4cb0-b0be-74b7a280be67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:28 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume 8fec4eeb-4423-424d-989a-e0da8546cbd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fec4eeb-4423-424d-989a-e0da8546cbd8', 'volume_size': 1} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-43791748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fec4eeb-4423-424d-989a-e0da8546cbd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72ea11d81574e21aea59af691c50309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:15:28Z,use_quota=True,user_id='365c8e5416604834ae3fc0ae91050acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Creating volume 8fec4eeb-4423-424d-989a-e0da8546cbd8 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:15:28 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8fec4eeb-4423-424d-989a-e0da8546cbd8 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:28 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8fec4eeb-4423-424d-989a-e0da8546cbd8 1073741824 Jul 03 14:15:28 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Flow 'volume_create_manager' (220a9728-d362-41fe-8fe2-abcdb67f5280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c33a1ab-1c26-4259-8640-924651fd2532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c33a1ab-1c26-4259-8640-924651fd2532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1304170767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2719c5db-629f-46ea-9d75-c7c4f36fb8f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72ea11d81574e21aea59af691c50309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:15:28Z,use_quota=True,user_id='365c8e5416604834ae3fc0ae91050acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15d5515-fe18-4640-a427-7df825c16b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15d5515-fe18-4640-a427-7df825c16b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9036dc6-c1b0-4383-98a8-21627b85b8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9036dc6-c1b0-4383-98a8-21627b85b8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2719c5db-629f-46ea-9d75-c7c4f36fb8f5', 'volume_name': 'volume-2719c5db-629f-46ea-9d75-c7c4f36fb8f5', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211ec366-0d2e-453d-b51c-37455d60274c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211ec366-0d2e-453d-b51c-37455d60274c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1900f6b0-2e62-4852-81d8-7b00b5cd42c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:28 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume 2719c5db-629f-46ea-9d75-c7c4f36fb8f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2719c5db-629f-46ea-9d75-c7c4f36fb8f5', 'volume_size': 1} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Flow 'volume_create_manager' (1abeec94-594e-47af-ac93-c916baa47f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e74d6719-a961-4793-9eba-312b91f6d6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e74d6719-a961-4793-9eba-312b91f6d6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1156303331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72ea11d81574e21aea59af691c50309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:15:29Z,use_quota=True,user_id='365c8e5416604834ae3fc0ae91050acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e949ad9-3843-4e51-a3f2-7a963d2b88e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e949ad9-3843-4e51-a3f2-7a963d2b88e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189e20c4-6773-45b5-8f2e-9fd69f990c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189e20c4-6773-45b5-8f2e-9fd69f990c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e', 'volume_name': 'volume-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe2fcb7-43b2-4cf0-8312-4cfa079c444b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe2fcb7-43b2-4cf0-8312-4cfa079c444b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4e8512-07c0-4631-b12e-c5724da7a6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:28 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume 841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e', 'volume_size': 1} Jul 03 14:15:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:29 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8fec4eeb-4423-424d-989a-e0da8546cbd8 1073741824" returned: 0 in 0.935s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8fec4eeb-4423-424d-989a-e0da8546cbd8 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:29 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8fec4eeb-4423-424d-989a-e0da8546cbd8 Jul 03 14:15:29 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Flow 'volume_create_manager' (d9f5e08f-b1d6-475f-9722-f0a095949362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff39d368-853a-4e76-bdaf-2b60b4fa8a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff39d368-853a-4e76-bdaf-2b60b4fa8a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2051452172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e1aad5-198b-44d9-944a-cb3980321e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72ea11d81574e21aea59af691c50309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:15:29Z,use_quota=True,user_id='365c8e5416604834ae3fc0ae91050acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c683460-7e57-495c-9686-59dc99d83803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c683460-7e57-495c-9686-59dc99d83803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12012c8e-9193-4ae4-b66a-ee31d952e1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12012c8e-9193-4ae4-b66a-ee31d952e1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e1aad5-198b-44d9-944a-cb3980321e85', 'volume_name': 'volume-a8e1aad5-198b-44d9-944a-cb3980321e85', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56456f2-e0e8-4ed7-8a97-5074bc490414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56456f2-e0e8-4ed7-8a97-5074bc490414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0039678c-8c36-4abc-b6f4-91c6661e30f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:29 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume a8e1aad5-198b-44d9-944a-cb3980321e85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e1aad5-198b-44d9-944a-cb3980321e85', 'volume_size': 1} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Flow 'volume_create_manager' (a8dea5a9-7c1d-47c8-afaf-114ce99a5c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61272dc3-ff8f-4bee-b887-eee781e0bbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61272dc3-ff8f-4bee-b887-eee781e0bbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1905056336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b851be8-e5c1-4956-aa20-f37fda58fece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72ea11d81574e21aea59af691c50309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:15:30Z,use_quota=True,user_id='365c8e5416604834ae3fc0ae91050acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a5c359-99ba-46bd-afe1-f8dec6841a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a5c359-99ba-46bd-afe1-f8dec6841a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b85876-7a9c-4649-ae12-dc746a9f12ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b85876-7a9c-4649-ae12-dc746a9f12ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b851be8-e5c1-4956-aa20-f37fda58fece', 'volume_name': 'volume-6b851be8-e5c1-4956-aa20-f37fda58fece', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea92f68-9d48-47a3-a4c6-7959f25b60d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea92f68-9d48-47a3-a4c6-7959f25b60d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c61b9e-91cb-4c9f-999f-a6939a738cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:29 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume 6b851be8-e5c1-4956-aa20-f37fda58fece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b851be8-e5c1-4956-aa20-f37fda58fece', 'volume_size': 1} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:29 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8fec4eeb-4423-424d-989a-e0da8546cbd8" returned: 0 in 0.678s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.331s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1304170767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2719c5db-629f-46ea-9d75-c7c4f36fb8f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72ea11d81574e21aea59af691c50309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:15:28Z,use_quota=True,user_id='365c8e5416604834ae3fc0ae91050acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Creating volume 2719c5db-629f-46ea-9d75-c7c4f36fb8f5 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:15:29 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2719c5db-629f-46ea-9d75-c7c4f36fb8f5 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:29 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2719c5db-629f-46ea-9d75-c7c4f36fb8f5 1073741824 Jul 03 14:15:29 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a829544-bd53-4cb0-b0be-74b7a280be67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fec4eeb-4423-424d-989a-e0da8546cbd8', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7fcf3dd-74c6-4b80-884a-86c561efa2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:29 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume volume-8fec4eeb-4423-424d-989a-e0da8546cbd8 (8fec4eeb-4423-424d-989a-e0da8546cbd8): created successfully Jul 03 14:15:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7fcf3dd-74c6-4b80-884a-86c561efa2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Flow 'volume_create_manager' (b0993cae-51ba-4207-8fbe-9dc6b9c960d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:15:30 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-bdd8ad90-e88f-457e-a431-57ebbf2e6030 tempest-CreateVolumesFromSnapshotTest-262474861 None] Created volume successfully. Jul 03 14:15:30 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2719c5db-629f-46ea-9d75-c7c4f36fb8f5 1073741824" returned: 0 in 0.777s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2719c5db-629f-46ea-9d75-c7c4f36fb8f5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:30 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2719c5db-629f-46ea-9d75-c7c4f36fb8f5 Jul 03 14:15:30 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:31 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2719c5db-629f-46ea-9d75-c7c4f36fb8f5" returned: 0 in 0.606s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:15:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.366s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1156303331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72ea11d81574e21aea59af691c50309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:15:29Z,use_quota=True,user_id='365c8e5416604834ae3fc0ae91050acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:15:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Creating volume 841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:15:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:15:31 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:15:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1900f6b0-2e62-4852-81d8-7b00b5cd42c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2719c5db-629f-46ea-9d75-c7c4f36fb8f5', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:31 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e 1073741824 Jul 03 14:15:31 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d391ab72-3e15-43c1-b3c6-2b6d237b9bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:31 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume volume-2719c5db-629f-46ea-9d75-c7c4f36fb8f5 (2719c5db-629f-46ea-9d75-c7c4f36fb8f5): created successfully Jul 03 14:15:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d391ab72-3e15-43c1-b3c6-2b6d237b9bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Flow 'volume_create_manager' (220a9728-d362-41fe-8fe2-abcdb67f5280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:15:31 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-20f4a15b-fbe7-468d-86b9-cf7f98f6139f tempest-CreateVolumesFromSnapshotTest-262474861 None] Created volume successfully. Jul 03 14:15:32 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e 1073741824" returned: 0 in 0.846s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:32 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e Jul 03 14:15:32 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:32 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e" returned: 0 in 0.677s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.491s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2051452172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e1aad5-198b-44d9-944a-cb3980321e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72ea11d81574e21aea59af691c50309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:15:29Z,use_quota=True,user_id='365c8e5416604834ae3fc0ae91050acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Creating volume a8e1aad5-198b-44d9-944a-cb3980321e85 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:15:32 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8e1aad5-198b-44d9-944a-cb3980321e85 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:32 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8e1aad5-198b-44d9-944a-cb3980321e85 1073741824 Jul 03 14:15:32 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4e8512-07c0-4631-b12e-c5724da7a6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a351cf3c-90be-4f3a-8d38-000a3d803a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:32 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume volume-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e (841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e): created successfully Jul 03 14:15:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a351cf3c-90be-4f3a-8d38-000a3d803a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:33 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Flow 'volume_create_manager' (1abeec94-594e-47af-ac93-c916baa47f5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:15:33 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-955b7774-8bdc-4718-9f50-7d2b8f5c9f5d tempest-CreateVolumesFromSnapshotTest-262474861 None] Created volume successfully. Jul 03 14:15:33 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8e1aad5-198b-44d9-944a-cb3980321e85 1073741824" returned: 0 in 0.871s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8e1aad5-198b-44d9-944a-cb3980321e85 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:33 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8e1aad5-198b-44d9-944a-cb3980321e85 Jul 03 14:15:33 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:34 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8e1aad5-198b-44d9-944a-cb3980321e85" returned: 0 in 0.693s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:15:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.734s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1905056336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b851be8-e5c1-4956-aa20-f37fda58fece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72ea11d81574e21aea59af691c50309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:15:30Z,use_quota=True,user_id='365c8e5416604834ae3fc0ae91050acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:15:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Creating volume 6b851be8-e5c1-4956-aa20-f37fda58fece {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:15:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:15:34 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:15:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6b851be8-e5c1-4956-aa20-f37fda58fece 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:34 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6b851be8-e5c1-4956-aa20-f37fda58fece 1073741824 Jul 03 14:15:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0039678c-8c36-4abc-b6f4-91c6661e30f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e1aad5-198b-44d9-944a-cb3980321e85', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:34 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0983fef-35e6-48aa-a843-e85a9c349196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:34 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume volume-a8e1aad5-198b-44d9-944a-cb3980321e85 (a8e1aad5-198b-44d9-944a-cb3980321e85): created successfully Jul 03 14:15:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0983fef-35e6-48aa-a843-e85a9c349196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Flow 'volume_create_manager' (d9f5e08f-b1d6-475f-9722-f0a095949362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:15:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-6d51e58c-ea9f-4b04-988b-3972e8ffc504 tempest-CreateVolumesFromSnapshotTest-262474861 None] Created volume successfully. Jul 03 14:15:35 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6b851be8-e5c1-4956-aa20-f37fda58fece 1073741824" returned: 0 in 0.926s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6b851be8-e5c1-4956-aa20-f37fda58fece {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:35 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6b851be8-e5c1-4956-aa20-f37fda58fece Jul 03 14:15:35 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:36 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6b851be8-e5c1-4956-aa20-f37fda58fece" returned: 0 in 0.705s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:15:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c61b9e-91cb-4c9f-999f-a6939a738cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b851be8-e5c1-4956-aa20-f37fda58fece', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d34350-ae85-4ae9-a267-1f7085b7b0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:36 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Volume volume-6b851be8-e5c1-4956-aa20-f37fda58fece (6b851be8-e5c1-4956-aa20-f37fda58fece): created successfully Jul 03 14:15:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d34350-ae85-4ae9-a267-1f7085b7b0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Flow 'volume_create_manager' (a8dea5a9-7c1d-47c8-afaf-114ce99a5c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:15:36 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-392d108a-84ad-4e04-aaa3-8dc0dc41cf85 tempest-CreateVolumesFromSnapshotTest-262474861 None] Created volume successfully. Jul 03 14:15:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "cinder-6b851be8-e5c1-4956-aa20-f37fda58fece-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-6b851be8-e5c1-4956-aa20-f37fda58fece-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "cinder-quobyte-6b851be8-e5c1-4956-aa20-f37fda58fece" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-quobyte-6b851be8-e5c1-4956-aa20-f37fda58fece" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:36 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedb80e3-1265-4aef-941d-ea346055832c]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6b851be8-e5c1-4956-aa20-f37fda58fece {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:36 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6b851be8-e5c1-4956-aa20-f37fda58fece Jul 03 14:15:36 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:37 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6b851be8-e5c1-4956-aa20-f37fda58fece" returned: 0 in 0.785s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6b851be8-e5c1-4956-aa20-f37fda58fece {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:37 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6b851be8-e5c1-4956-aa20-f37fda58fece Jul 03 14:15:37 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:38 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6b851be8-e5c1-4956-aa20-f37fda58fece" returned: 0 in 0.692s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-quobyte-6b851be8-e5c1-4956-aa20-f37fda58fece" released by "delete_volume" :: held 1.517s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:38 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] Created reservations ['45b93cb0-3488-40ab-9260-f5a1b15fb37e', '84ff63dc-7f78-482a-9c9f-8125332e7a08', '4143dcee-d336-4fda-be61-dfaedab5cd4c', 'a87eb99b-4354-4d9f-af3a-cb9e3c1a44ba'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:15:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:38 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:15:38 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "cinder-a8e1aad5-198b-44d9-944a-cb3980321e85-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-a8e1aad5-198b-44d9-944a-cb3980321e85-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "cinder-quobyte-a8e1aad5-198b-44d9-944a-cb3980321e85" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-quobyte-a8e1aad5-198b-44d9-944a-cb3980321e85" acquired by "delete_volume" :: waited 0.023s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:38 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfdfbae-b0b9-434c-b2e5-9376b504cf5a]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8e1aad5-198b-44d9-944a-cb3980321e85 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:38 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.728s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:38 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:15:38 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] Deleted volume successfully. Jul 03 14:15:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0bc5bfd0-05ba-4854-b713-0a44a01c5f7d tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-6b851be8-e5c1-4956-aa20-f37fda58fece-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:39 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8e1aad5-198b-44d9-944a-cb3980321e85 Jul 03 14:15:39 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:39 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8e1aad5-198b-44d9-944a-cb3980321e85" returned: 0 in 0.872s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8e1aad5-198b-44d9-944a-cb3980321e85 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:39 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8e1aad5-198b-44d9-944a-cb3980321e85 Jul 03 14:15:39 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:40 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a8e1aad5-198b-44d9-944a-cb3980321e85" returned: 0 in 0.740s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-quobyte-a8e1aad5-198b-44d9-944a-cb3980321e85" released by "delete_volume" :: held 1.660s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:40 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] Created reservations ['2945e888-b397-4a16-b972-8ab10c7b27f7', '716bb80f-3744-4dfc-a02e-814004b43346', '339ad3ef-c1a1-4e67-99cf-64738cd8c5c0', '5e057e54-6206-4c4e-baba-83223b9b78e1'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:15:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:40 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:15:40 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "cinder-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "cinder-quobyte-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-quobyte-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:41 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f35986-387c-48dd-9457-04059427cea1]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:41 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e Jul 03 14:15:41 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:41 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.713s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:41 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:15:41 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] Deleted volume successfully. Jul 03 14:15:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5f95558f-4da4-4976-9541-56f31484257f tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-a8e1aad5-198b-44d9-944a-cb3980321e85-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:41 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e" returned: 0 in 0.801s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:42 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e Jul 03 14:15:42 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:42 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e" returned: 0 in 0.703s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-quobyte-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e" released by "delete_volume" :: held 1.547s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:42 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] Created reservations ['c9f4fbe1-e6a7-42c9-9fb5-fc5ce878b46b', 'c56fb976-0575-48be-bd74-dcd77955b9ff', '498d4d77-3886-4959-bd7e-299a0a48146a', 'ebbfcaca-699b-484e-827a-ad305e2ad641'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:15:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:42 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:15:42 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "cinder-2719c5db-629f-46ea-9d75-c7c4f36fb8f5-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-2719c5db-629f-46ea-9d75-c7c4f36fb8f5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "cinder-quobyte-2719c5db-629f-46ea-9d75-c7c4f36fb8f5" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-quobyte-2719c5db-629f-46ea-9d75-c7c4f36fb8f5" acquired by "delete_volume" :: waited 0.021s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:43 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[040436e6-233f-4239-8b0a-fa542e5dbf66]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2719c5db-629f-46ea-9d75-c7c4f36fb8f5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:43 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.735s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:43 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:15:43 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] Deleted volume successfully. Jul 03 14:15:43 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2719c5db-629f-46ea-9d75-c7c4f36fb8f5 Jul 03 14:15:43 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e803aa22-261c-40e3-99ef-e3701656d791 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-841b7575-3d50-42a7-b2fb-0d1fe3a6dc9e-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:44 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2719c5db-629f-46ea-9d75-c7c4f36fb8f5" returned: 0 in 0.800s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2719c5db-629f-46ea-9d75-c7c4f36fb8f5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:44 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2719c5db-629f-46ea-9d75-c7c4f36fb8f5 Jul 03 14:15:44 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:44 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2719c5db-629f-46ea-9d75-c7c4f36fb8f5" returned: 0 in 0.717s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:44 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-quobyte-2719c5db-629f-46ea-9d75-c7c4f36fb8f5" released by "delete_volume" :: held 1.561s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:45 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] Created reservations ['6562f76e-8bcb-4548-a65f-6177ff783419', 'f7c15bc3-24eb-4595-b6e8-2f1f0d66891f', '2bac9000-380e-40f6-b771-38699807a738', '890a7f92-7d7d-43da-bb6b-b096c460aed1'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:15:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:45 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:15:45 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:45 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "cinder-8fec4eeb-4423-424d-989a-e0da8546cbd8-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:45 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-8fec4eeb-4423-424d-989a-e0da8546cbd8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:45 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "cinder-quobyte-8fec4eeb-4423-424d-989a-e0da8546cbd8" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:45 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-quobyte-8fec4eeb-4423-424d-989a-e0da8546cbd8" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:45 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[c485829d-0558-464d-87e8-4db0789fb063]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8fec4eeb-4423-424d-989a-e0da8546cbd8 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:45 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8fec4eeb-4423-424d-989a-e0da8546cbd8 Jul 03 14:15:45 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:45 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.705s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:45 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:15:45 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] Deleted volume successfully. Jul 03 14:15:45 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5a4d90da-340a-4e92-b073-71770183d8f1 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-2719c5db-629f-46ea-9d75-c7c4f36fb8f5-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:46 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8fec4eeb-4423-424d-989a-e0da8546cbd8" returned: 0 in 0.805s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8fec4eeb-4423-424d-989a-e0da8546cbd8 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:46 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8fec4eeb-4423-424d-989a-e0da8546cbd8 Jul 03 14:15:46 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:47 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-8fec4eeb-4423-424d-989a-e0da8546cbd8" returned: 0 in 0.676s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-quobyte-8fec4eeb-4423-424d-989a-e0da8546cbd8" released by "delete_volume" :: held 1.521s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] Created reservations ['35c2be31-384f-46a2-91b0-a835d43380b5', '085ddcba-9e7c-4d04-bccd-5eeadeb7574d', 'abe08894-de6c-4aee-ab37-1c1b5076ee71', '7dee3d99-e8a2-47a0-be64-fecf52b8100f'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:47 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:15:47 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "cinder-e68c9b61-ea6c-481c-8bbc-5ad20f75beaf-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-e68c9b61-ea6c-481c-8bbc-5ad20f75beaf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "cinder-quobyte-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-quobyte-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "cinder-quobyte-e68c9b61-ea6c-481c-8bbc-5ad20f75beaf" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-quobyte-e68c9b61-ea6c-481c-8bbc-5ad20f75beaf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] Deleting offline snapshot e68c9b61-ea6c-481c-8bbc-5ad20f75beaf of volume 5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] snapshot_file for this snap is: volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a8aa0c-e1ed-4f2c-9f7f-cc2163b8df74]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:48 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf Jul 03 14:15:48 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:48 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.765s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:48 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:15:48 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] Deleted volume successfully. Jul 03 14:15:48 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e32510b4-5c00-4870-aab5-29574120dd71 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-8fec4eeb-4423-424d-989a-e0da8546cbd8-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:48 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf" returned: 0 in 0.766s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:48 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:15:48 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[944bfc5c-6398-410c-b4ee-4b91d7dee50d]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:48 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 Jul 03 14:15:48 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:49 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116" returned: 0 in 0.791s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:49 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf Jul 03 14:15:49 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:50 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf" returned: 0 in 0.779s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:50 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf Jul 03 14:15:50 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:50 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116.e68c9b61-ea6c-481c-8bbc-5ad20f75beaf" returned: 0 in 0.662s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-quobyte-e68c9b61-ea6c-481c-8bbc-5ad20f75beaf" released by "_delete_snapshot" :: held 3.109s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:50 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-quobyte-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116" released by "delete_snapshot" :: held 3.133s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:51 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] Created reservations ['5b5727c0-f9f9-4396-baa1-72f62f6f689c', '4e394d55-aae9-4371-b854-372edfef5822', '03bed443-397f-4133-a33e-cf8d8752fb82', 'd10b21f7-ce49-4917-8973-691da53a5e55'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:15:51 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] Delete snapshot completed successfully. Jul 03 14:15:51 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-cf2e44f0-0dcf-441c-ab02-75a8dc8e3914 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-e68c9b61-ea6c-481c-8bbc-5ad20f75beaf-delete_snapshot" released by "delete_snapshot" :: held 3.286s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "cinder-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "cinder-quobyte-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-quobyte-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116" acquired by "delete_volume" :: waited 0.021s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:52 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f094528-bf7e-49f2-827f-200fdb500931]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:52 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 Jul 03 14:15:52 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:52 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116" returned: 0 in 0.805s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:52 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116 Jul 03 14:15:52 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:53 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116" returned: 0 in 0.702s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-quobyte-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116" released by "delete_volume" :: held 1.562s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:53 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] Created reservations ['3c269d23-382f-4a38-a15b-90a8802fe622', 'a8b0c42d-b866-4491-a3eb-84a1184f88b4', '796ddd1a-5032-4061-b5b0-8797ac973472', '93fac127-f8ed-442f-a003-7db1f536e3d9'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:15:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:53 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:15:53 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:54 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.708s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:54 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:15:54 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] Deleted volume successfully. Jul 03 14:15:54 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-308e9a02-e1c3-4cd5-92b0-e07b771ae152 tempest-CreateVolumesFromSnapshotTest-262474861 None] Lock "cinder-5b1dd55f-6ed7-4f5d-8d61-2fa11ca99116-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:15:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:58 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:15:58 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:59 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.631s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:04 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=76,cinder:SELECT=47,cinder:INSERT=16,cinder:DELETE=6 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:16:04 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=56,cinder:UPDATE=71,cinder:INSERT=19,cinder:DELETE=7 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Flow 'volume_create_manager' (97973976-59b3-4ba6-8c6d-71a5c1cdbcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bb8fb6-5ed0-4e24-8624-db4f870dc8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bb8fb6-5ed0-4e24-8624-db4f870dc8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1795357617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185ab22a-3143-4b23-950b-83475dfbd20a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74dd7df9d91b42f78b9fbf2f2b3cf1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:06Z,use_quota=True,user_id='aaa98d35089847fc856a8cad30cc1c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b18f43-8fc1-4ba4-adb1-48d993ba6d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b18f43-8fc1-4ba4-adb1-48d993ba6d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91916648-ffb5-4b8f-a700-581a97f937c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91916648-ffb5-4b8f-a700-581a97f937c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '185ab22a-3143-4b23-950b-83475dfbd20a', 'volume_name': 'volume-185ab22a-3143-4b23-950b-83475dfbd20a', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49dec3e-970c-401f-a1ee-f95495b65b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49dec3e-970c-401f-a1ee-f95495b65b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce3e5f0-ff13-4ec9-b1d2-404d664fba1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:05 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Volume 185ab22a-3143-4b23-950b-83475dfbd20a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-185ab22a-3143-4b23-950b-83475dfbd20a', 'volume_size': 1} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1795357617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185ab22a-3143-4b23-950b-83475dfbd20a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74dd7df9d91b42f78b9fbf2f2b3cf1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:06Z,use_quota=True,user_id='aaa98d35089847fc856a8cad30cc1c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Creating volume 185ab22a-3143-4b23-950b-83475dfbd20a {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:16:05 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:16:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-185ab22a-3143-4b23-950b-83475dfbd20a 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:05 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-185ab22a-3143-4b23-950b-83475dfbd20a 1073741824 Jul 03 14:16:05 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Flow 'volume_create_manager' (2198b881-e173-4ae7-9db6-50f4ccb3d36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9413fe72-587e-4b5f-bfec-522f44c154a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9413fe72-587e-4b5f-bfec-522f44c154a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1564272817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfa926f-56d4-4561-a6be-ebfd9c3091be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74dd7df9d91b42f78b9fbf2f2b3cf1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:06Z,use_quota=True,user_id='aaa98d35089847fc856a8cad30cc1c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ba7d6b-c106-4467-a8d1-495ce902dc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ba7d6b-c106-4467-a8d1-495ce902dc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6023cb29-9f56-4d4e-a889-b35bf97b6ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6023cb29-9f56-4d4e-a889-b35bf97b6ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dfa926f-56d4-4561-a6be-ebfd9c3091be', 'volume_name': 'volume-9dfa926f-56d4-4561-a6be-ebfd9c3091be', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7be112b-77fd-48e2-a1e6-4a263475849b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7be112b-77fd-48e2-a1e6-4a263475849b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e313cb7-9c48-414b-b1d2-6a63e513a468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:06 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Volume 9dfa926f-56d4-4561-a6be-ebfd9c3091be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dfa926f-56d4-4561-a6be-ebfd9c3091be', 'volume_size': 1} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Flow 'volume_create_manager' (464e522a-7f55-4e23-b6f8-6db71ad6783a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9484331-8da3-466b-b769-a31f8b53d321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9484331-8da3-466b-b769-a31f8b53d321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1563540625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f04c31a-2846-42b0-98df-fbddfa952d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f4caaefa7e48a18e307fc06d16dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:07Z,use_quota=True,user_id='b41f99d601fc491d98c8e9aef3b6b94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d286cc99-0bc4-4fa0-a587-fb8073d316ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d286cc99-0bc4-4fa0-a587-fb8073d316ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3b4fba-cafe-459a-a1c0-a281575f929d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3b4fba-cafe-459a-a1c0-a281575f929d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f04c31a-2846-42b0-98df-fbddfa952d1b', 'volume_name': 'volume-7f04c31a-2846-42b0-98df-fbddfa952d1b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c739e1-0e24-4eac-9189-fab77b33163c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c739e1-0e24-4eac-9189-fab77b33163c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf5d672-1f98-4841-a5be-7d5f25d1a7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:06 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume 7f04c31a-2846-42b0-98df-fbddfa952d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f04c31a-2846-42b0-98df-fbddfa952d1b', 'volume_size': 1} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Flow 'volume_create_manager' (10f5d62c-0387-4513-9bc1-d94ae02bd3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfaab641-8a40-499b-9ae6-6316a30598d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:06 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfaab641-8a40-499b-9ae6-6316a30598d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1816355737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bdcef3-0d6a-488a-8633-508fddd68bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74dd7df9d91b42f78b9fbf2f2b3cf1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:07Z,use_quota=True,user_id='aaa98d35089847fc856a8cad30cc1c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d04cb07-a0b7-493e-83f9-723fcb6948ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d04cb07-a0b7-493e-83f9-723fcb6948ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc357b6d-6639-4a52-9d21-4c0f6624f84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc357b6d-6639-4a52-9d21-4c0f6624f84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4bdcef3-0d6a-488a-8633-508fddd68bfd', 'volume_name': 'volume-b4bdcef3-0d6a-488a-8633-508fddd68bfd', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775ae3cf-dd35-464a-9302-b07c9d035f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775ae3cf-dd35-464a-9302-b07c9d035f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e56e3d-a9c7-424c-97a5-6f364e9d060c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:07 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Volume b4bdcef3-0d6a-488a-8633-508fddd68bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4bdcef3-0d6a-488a-8633-508fddd68bfd', 'volume_size': 1} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:07 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-185ab22a-3143-4b23-950b-83475dfbd20a 1073741824" returned: 0 in 1.264s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-185ab22a-3143-4b23-950b-83475dfbd20a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:07 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-185ab22a-3143-4b23-950b-83475dfbd20a Jul 03 14:16:07 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Flow 'volume_create_manager' (8b203912-7f13-4293-8a3a-21539bb621bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b57e80-b2b8-4cb2-a503-8e89161663b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b57e80-b2b8-4cb2-a503-8e89161663b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-673056908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4ff6eb-4f76-4896-b7bd-4e5f36b00124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74dd7df9d91b42f78b9fbf2f2b3cf1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:07Z,use_quota=True,user_id='aaa98d35089847fc856a8cad30cc1c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b208a7-3199-4fb8-afd8-7d338da9954e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b208a7-3199-4fb8-afd8-7d338da9954e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a322b43c-209b-4188-90c4-0f7793ec5874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a322b43c-209b-4188-90c4-0f7793ec5874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e4ff6eb-4f76-4896-b7bd-4e5f36b00124', 'volume_name': 'volume-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d60115e-0dc5-450c-a9b5-1ce179ea6764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d60115e-0dc5-450c-a9b5-1ce179ea6764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32d5000-457f-41dc-88b9-194fabe4add9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:07 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Volume 3e4ff6eb-4f76-4896-b7bd-4e5f36b00124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124', 'volume_size': 1} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Flow 'volume_create_manager' (d990e463-163a-4ada-89c0-ceb267501a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d767721-fe1b-413c-a17f-017ccd2c5ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d767721-fe1b-413c-a17f-017ccd2c5ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1066718033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5d5ccb-758c-4e5c-8c69-eee7fc70546b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74dd7df9d91b42f78b9fbf2f2b3cf1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:08Z,use_quota=True,user_id='aaa98d35089847fc856a8cad30cc1c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a66bf8-451c-4199-b05f-cfe67c1136ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a66bf8-451c-4199-b05f-cfe67c1136ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca6f0fb-7fdb-4820-a422-f696f4a713a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca6f0fb-7fdb-4820-a422-f696f4a713a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f5d5ccb-758c-4e5c-8c69-eee7fc70546b', 'volume_name': 'volume-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:07 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36dc8de-da53-47ec-aab7-dd955e21e5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36dc8de-da53-47ec-aab7-dd955e21e5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba26ee2-4d36-4238-af0d-f6309c524393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:07 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Volume 2f5d5ccb-758c-4e5c-8c69-eee7fc70546b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b', 'volume_size': 1} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-185ab22a-3143-4b23-950b-83475dfbd20a" returned: 0 in 0.796s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] <== create_volume: return (2113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.116s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.544s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1564272817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfa926f-56d4-4561-a6be-ebfd9c3091be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74dd7df9d91b42f78b9fbf2f2b3cf1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:06Z,use_quota=True,user_id='aaa98d35089847fc856a8cad30cc1c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Creating volume 9dfa926f-56d4-4561-a6be-ebfd9c3091be {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:16:08 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:16:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9dfa926f-56d4-4561-a6be-ebfd9c3091be 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce3e5f0-ff13-4ec9-b1d2-404d664fba1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-185ab22a-3143-4b23-950b-83475dfbd20a', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:08 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9dfa926f-56d4-4561-a6be-ebfd9c3091be 1073741824 Jul 03 14:16:08 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c513b8-ed88-4f76-bae5-f692add0ff5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:08 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Volume volume-185ab22a-3143-4b23-950b-83475dfbd20a (185ab22a-3143-4b23-950b-83475dfbd20a): created successfully Jul 03 14:16:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c513b8-ed88-4f76-bae5-f692add0ff5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Flow 'volume_create_manager' (97973976-59b3-4ba6-8c6d-71a5c1cdbcce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:08 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-9e9c6c2f-fd2f-476d-9105-a1343328c4d2 tempest-CreateVolumesFromImageTest-1634063876 None] Created volume successfully. Jul 03 14:16:08 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9dfa926f-56d4-4561-a6be-ebfd9c3091be 1073741824" returned: 0 in 0.967s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9dfa926f-56d4-4561-a6be-ebfd9c3091be {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:09 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9dfa926f-56d4-4561-a6be-ebfd9c3091be Jul 03 14:16:09 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:09 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9dfa926f-56d4-4561-a6be-ebfd9c3091be" returned: 0 in 0.727s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.857s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1563540625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f04c31a-2846-42b0-98df-fbddfa952d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f4caaefa7e48a18e307fc06d16dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:07Z,use_quota=True,user_id='b41f99d601fc491d98c8e9aef3b6b94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Creating volume 7f04c31a-2846-42b0-98df-fbddfa952d1b {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:16:09 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f04c31a-2846-42b0-98df-fbddfa952d1b 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:09 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f04c31a-2846-42b0-98df-fbddfa952d1b 1073741824 Jul 03 14:16:09 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e313cb7-9c48-414b-b1d2-6a63e513a468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dfa926f-56d4-4561-a6be-ebfd9c3091be', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee096d9a-50f0-4c34-8c65-3fe33de554cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:09 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Volume volume-9dfa926f-56d4-4561-a6be-ebfd9c3091be (9dfa926f-56d4-4561-a6be-ebfd9c3091be): created successfully Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee096d9a-50f0-4c34-8c65-3fe33de554cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:09 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Flow 'volume_create_manager' (2198b881-e173-4ae7-9db6-50f4ccb3d36b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:09 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-544504fd-ffcd-4371-b4f9-f9c3d2af506f tempest-CreateVolumesFromImageTest-1634063876 None] Created volume successfully. Jul 03 14:16:10 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f04c31a-2846-42b0-98df-fbddfa952d1b 1073741824" returned: 0 in 0.938s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f04c31a-2846-42b0-98df-fbddfa952d1b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:10 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f04c31a-2846-42b0-98df-fbddfa952d1b Jul 03 14:16:10 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Flow 'volume_create_manager' (6247e481-78d1-4743-9d54-839587eeab5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8e7ad3-0f1a-4cc3-bf3d-185b52f2213c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8e7ad3-0f1a-4cc3-bf3d-185b52f2213c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ada150f-da58-4cf2-9e1b-235f6bf7c4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50118a3cefd14ba195e6f942e56e8518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:11Z,use_quota=True,user_id='ddb6a77d8880435da8b14f860964ba13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97983eb9-8a33-42ab-9b69-390ae209695a),volume_type_id=97983eb9-8a33-42ab-9b69-390ae209695a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3def9314-11e8-4dcb-903c-e50141545ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3def9314-11e8-4dcb-903c-e50141545ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f5e07e-7993-4a36-a35f-977d81127bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.image.glance [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Creating Keystone auth plugin from conf {{(pid=86805) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 14:16:11 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f04c31a-2846-42b0-98df-fbddfa952d1b" returned: 0 in 0.769s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.461s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1816355737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bdcef3-0d6a-488a-8633-508fddd68bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74dd7df9d91b42f78b9fbf2f2b3cf1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:07Z,use_quota=True,user_id='aaa98d35089847fc856a8cad30cc1c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Creating volume b4bdcef3-0d6a-488a-8633-508fddd68bfd {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:16:11 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4bdcef3-0d6a-488a-8633-508fddd68bfd 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf5d672-1f98-4841-a5be-7d5f25d1a7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f04c31a-2846-42b0-98df-fbddfa952d1b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:11 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4bdcef3-0d6a-488a-8633-508fddd68bfd 1073741824 Jul 03 14:16:11 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e60f232-087a-4b0d-bf2b-db925fa5cc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:11 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume volume-7f04c31a-2846-42b0-98df-fbddfa952d1b (7f04c31a-2846-42b0-98df-fbddfa952d1b): created successfully Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e60f232-087a-4b0d-bf2b-db925fa5cc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Flow 'volume_create_manager' (464e522a-7f55-4e23-b6f8-6db71ad6783a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:11 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-8678a167-5f5a-4e32-be00-3ea3acf91ca8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Created volume successfully. Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f5e07e-7993-4a36-a35f-977d81127bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7ada150f-da58-4cf2-9e1b-235f6bf7c4d3', 'volume_name': 'volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3', 'volume_size': 1, 'image_id': '2bef5a29-a7d4-411d-afab-59757d740fa1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bef5a29-a7d4-411d-afab-59757d740fa1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b02a9197d1535f4c489c9c303ce307eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '50118a3cefd14ba195e6f942e56e8518', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e0c81a9e6128f622bcf0fa8b63902d663426780cbf5e5f96cf36e3848ecfadc33b01fbf7269dc3d070e82b2be0bebc8891673eac8a240c12f3a6ca1e640049e', 'id': '2bef5a29-a7d4-411d-afab-59757d740fa1', 'created_at': datetime.datetime(2026, 7, 3, 12, 16, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 16, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bef5a29-a7d4-411d-afab-59757d740fa1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec227910-baef-4ed5-ba96-1ea7566571a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec227910-baef-4ed5-ba96-1ea7566571a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d4c00f-1b5c-45ac-93dc-530371a1e7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:11 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Volume 7ada150f-da58-4cf2-9e1b-235f6bf7c4d3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3', 'volume_size': 1, 'image_id': '2bef5a29-a7d4-411d-afab-59757d740fa1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bef5a29-a7d4-411d-afab-59757d740fa1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b02a9197d1535f4c489c9c303ce307eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '50118a3cefd14ba195e6f942e56e8518', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e0c81a9e6128f622bcf0fa8b63902d663426780cbf5e5f96cf36e3848ecfadc33b01fbf7269dc3d070e82b2be0bebc8891673eac8a240c12f3a6ca1e640049e', 'id': '2bef5a29-a7d4-411d-afab-59757d740fa1', 'created_at': datetime.datetime(2026, 7, 3, 12, 16, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 16, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bef5a29-a7d4-411d-afab-59757d740fa1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Trying to clone 7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 from image 2bef5a29-a7d4-411d-afab-59757d740fa1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2bef5a29-a7d4-411d-afab-59757d740fa1', 'metadata': {}}]). {{(pid=86805) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 14:16:11 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Image download 0.00 MB at 0.00 MB/s Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ba0c89-df6d-4a8d-8209-66993345579c]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:11 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD Jul 03 14:16:11 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:12 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4bdcef3-0d6a-488a-8633-508fddd68bfd 1073741824" returned: 0 in 0.932s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4bdcef3-0d6a-488a-8633-508fddd68bfd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:12 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4bdcef3-0d6a-488a-8633-508fddd68bfd Jul 03 14:16:12 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:12 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD" returned: 0 in 0.807s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:12 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD Jul 03 14:16:12 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:12 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Flow 'volume_create_manager' (b449ca7c-7493-4d5d-bca9-7069fbc8e8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d24a3ed-ce43-430d-b5d3-70e1fd3ff847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d24a3ed-ce43-430d-b5d3-70e1fd3ff847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-793950968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c5fde58-3efa-46fb-b03b-0aae018bc536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f4caaefa7e48a18e307fc06d16dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:13Z,use_quota=True,user_id='b41f99d601fc491d98c8e9aef3b6b94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c2bc27-7a91-4b57-9eda-2f80daa4ac29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c2bc27-7a91-4b57-9eda-2f80daa4ac29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d3ac3d-b61d-4ff1-8c31-eb0e0ced9434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d3ac3d-b61d-4ff1-8c31-eb0e0ced9434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c5fde58-3efa-46fb-b03b-0aae018bc536', 'volume_name': 'volume-0c5fde58-3efa-46fb-b03b-0aae018bc536', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac4d550-75f0-4b86-8ab2-a0b8ab008982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac4d550-75f0-4b86-8ab2-a0b8ab008982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45474fc-ba12-45ca-91e7-b640590a0b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:13 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume 0c5fde58-3efa-46fb-b03b-0aae018bc536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c5fde58-3efa-46fb-b03b-0aae018bc536', 'volume_size': 1} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Flow 'volume_create_manager' (383456e2-714f-4e17-a030-1897445a82d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ece539-16b9-458b-9266-2deaa085de89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ece539-16b9-458b-9266-2deaa085de89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-822288780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4958170c-4f53-46eb-a401-6e7a2aa5fea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f4caaefa7e48a18e307fc06d16dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:13Z,use_quota=True,user_id='b41f99d601fc491d98c8e9aef3b6b94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef65106-2fcc-4d19-96ac-555bf4298942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef65106-2fcc-4d19-96ac-555bf4298942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d2beb3-66a9-4f2d-b698-bbd580d37ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d2beb3-66a9-4f2d-b698-bbd580d37ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4958170c-4f53-46eb-a401-6e7a2aa5fea0', 'volume_name': 'volume-4958170c-4f53-46eb-a401-6e7a2aa5fea0', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359d9316-77f1-4175-916b-ddb84a9f3b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359d9316-77f1-4175-916b-ddb84a9f3b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89855d57-fcf5-43eb-a728-41dc6433ec1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:13 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume 4958170c-4f53-46eb-a401-6e7a2aa5fea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4958170c-4f53-46eb-a401-6e7a2aa5fea0', 'volume_size': 1} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:13 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4bdcef3-0d6a-488a-8633-508fddd68bfd" returned: 0 in 1.120s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] <== create_volume: return (2115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.121s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.075s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-673056908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4ff6eb-4f76-4896-b7bd-4e5f36b00124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74dd7df9d91b42f78b9fbf2f2b3cf1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:07Z,use_quota=True,user_id='aaa98d35089847fc856a8cad30cc1c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Creating volume 3e4ff6eb-4f76-4896-b7bd-4e5f36b00124 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:16:13 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:13 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:13 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124 1073741824 Jul 03 14:16:13 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD" returned: 1 in 1.061s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Temporary image 2bef5a29-a7d4-411d-afab-59757d740fa1 is fetched for user ddb6a77d8880435da8b14f860964ba13. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e56e3d-a9c7-424c-97a5-6f364e9d060c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4bdcef3-0d6a-488a-8633-508fddd68bfd', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984d58e0-b3f9-4006-aade-6ef8c21018f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Flow 'volume_create_manager' (7ef1bdc4-a426-4326-ab37-9f96cf52148c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfa96b7-6567-4565-9088-dd48878037c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:13 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Volume volume-b4bdcef3-0d6a-488a-8633-508fddd68bfd (b4bdcef3-0d6a-488a-8633-508fddd68bfd): created successfully Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984d58e0-b3f9-4006-aade-6ef8c21018f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Flow 'volume_create_manager' (10f5d62c-0387-4513-9bc1-d94ae02bd3c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfa96b7-6567-4565-9088-dd48878037c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1967644643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8f4766-48de-431b-aead-2dbfb4ac1412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f4caaefa7e48a18e307fc06d16dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:14Z,use_quota=True,user_id='b41f99d601fc491d98c8e9aef3b6b94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ea41e0-e4cf-4e52-8ef0-a7dc8a9f4828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ea41e0-e4cf-4e52-8ef0-a7dc8a9f4828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1801c413-b68c-463c-ac49-113bfa3212c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1801c413-b68c-463c-ac49-113bfa3212c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f8f4766-48de-431b-aead-2dbfb4ac1412', 'volume_name': 'volume-7f8f4766-48de-431b-aead-2dbfb4ac1412', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d3c365-30e2-4ea2-bb8a-94ea0a2cfb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d3c365-30e2-4ea2-bb8a-94ea0a2cfb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbee18d-6b4f-4b89-9dac-9670bfa4d137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:13 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume 7f8f4766-48de-431b-aead-2dbfb4ac1412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f8f4766-48de-431b-aead-2dbfb4ac1412', 'volume_size': 1} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:13 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f6b72e98-2b10-4e26-8f86-93b09a45178c tempest-CreateVolumesFromImageTest-1634063876 None] Created volume successfully. Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d0e63f-5ff5-4e1f-9b5b-e7bc8a9ad733]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:14 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD Jul 03 14:16:14 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Flow 'volume_create_manager' (6c2484b0-2bb6-4faf-8009-a12fe2e1b352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c73521-3211-4b26-9c25-f6f2770ffbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c73521-3211-4b26-9c25-f6f2770ffbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1796466868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27912ca2-0acd-4931-97f8-8b890ccce79b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f4caaefa7e48a18e307fc06d16dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:14Z,use_quota=True,user_id='b41f99d601fc491d98c8e9aef3b6b94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c015672e-e9bb-4119-8e1c-8e076cbec963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c015672e-e9bb-4119-8e1c-8e076cbec963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32cae382-a509-45c7-b6e7-9059e7d2110c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32cae382-a509-45c7-b6e7-9059e7d2110c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27912ca2-0acd-4931-97f8-8b890ccce79b', 'volume_name': 'volume-27912ca2-0acd-4931-97f8-8b890ccce79b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26246add-d405-41dc-9862-11a4745bb878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26246add-d405-41dc-9862-11a4745bb878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59382208-3220-43cd-80db-f30d9a46b54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:14 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume 27912ca2-0acd-4931-97f8-8b890ccce79b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27912ca2-0acd-4931-97f8-8b890ccce79b', 'volume_size': 1} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Flow 'volume_create_manager' (d5b404d8-6aaf-47f9-b8a9-fc3241f1d755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7487e809-ea36-4e04-8f15-16bec51c5b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7487e809-ea36-4e04-8f15-16bec51c5b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-442265812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf93fff6-4045-4002-8fd6-6976b1118855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f4caaefa7e48a18e307fc06d16dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:15Z,use_quota=True,user_id='b41f99d601fc491d98c8e9aef3b6b94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:14 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa34be08-b802-498f-9bd2-6a79e088f6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa34be08-b802-498f-9bd2-6a79e088f6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9809ae3f-9ea7-4cc0-b10c-105461978217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9809ae3f-9ea7-4cc0-b10c-105461978217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf93fff6-4045-4002-8fd6-6976b1118855', 'volume_name': 'volume-cf93fff6-4045-4002-8fd6-6976b1118855', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c63e52-3050-46ba-a5e6-548eafc7c802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c63e52-3050-46ba-a5e6-548eafc7c802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d77cf8-3e96-40cf-a90e-3dafe42a1e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:14 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume cf93fff6-4045-4002-8fd6-6976b1118855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf93fff6-4045-4002-8fd6-6976b1118855', 'volume_size': 1} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124 1073741824" returned: 0 in 1.191s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:14 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124 Jul 03 14:16:14 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:14 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD" returned: 0 in 1.037s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:15 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD Jul 03 14:16:15 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:15 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124" returned: 0 in 0.734s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.634s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1066718033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5d5ccb-758c-4e5c-8c69-eee7fc70546b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74dd7df9d91b42f78b9fbf2f2b3cf1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:08Z,use_quota=True,user_id='aaa98d35089847fc856a8cad30cc1c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Creating volume 2f5d5ccb-758c-4e5c-8c69-eee7fc70546b {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:16:15 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32d5000-457f-41dc-88b9-194fabe4add9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f858f9c-889c-4b2a-8611-c13452236829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:15 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b 1073741824 Jul 03 14:16:15 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:15 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Volume volume-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124 (3e4ff6eb-4f76-4896-b7bd-4e5f36b00124): created successfully Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f858f9c-889c-4b2a-8611-c13452236829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Flow 'volume_create_manager' (8b203912-7f13-4293-8a3a-21539bb621bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:15 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-42a7e7d1-a21c-45ba-bc46-30596b9ff847 tempest-CreateVolumesFromImageTest-1634063876 None] Created volume successfully. Jul 03 14:16:15 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD" returned: 1 in 0.844s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:16:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:16 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b 1073741824" returned: 0 in 0.821s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:16 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b Jul 03 14:16:16 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:17 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b" returned: 0 in 0.718s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.082s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-793950968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c5fde58-3efa-46fb-b03b-0aae018bc536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f4caaefa7e48a18e307fc06d16dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:13Z,use_quota=True,user_id='b41f99d601fc491d98c8e9aef3b6b94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Creating volume 0c5fde58-3efa-46fb-b03b-0aae018bc536 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:16:17 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0c5fde58-3efa-46fb-b03b-0aae018bc536 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba26ee2-4d36-4238-af0d-f6309c524393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:17 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0c5fde58-3efa-46fb-b03b-0aae018bc536 1073741824 Jul 03 14:16:17 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134d6dab-afb6-46e9-8507-0c09168b0479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:17 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Volume volume-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b (2f5d5ccb-758c-4e5c-8c69-eee7fc70546b): created successfully Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134d6dab-afb6-46e9-8507-0c09168b0479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Flow 'volume_create_manager' (d990e463-163a-4ada-89c0-ceb267501a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:17 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4724701a-f05f-4937-98b6-98f7c0e22474 tempest-CreateVolumesFromImageTest-1634063876 None] Created volume successfully. Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "cinder-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "cinder-quobyte-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-quobyte-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b" acquired by "delete_volume" :: waited 0.014s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7b981b-9684-4d67-8551-6c2005cac890]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:18 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0c5fde58-3efa-46fb-b03b-0aae018bc536 1073741824" returned: 0 in 0.857s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0c5fde58-3efa-46fb-b03b-0aae018bc536 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:18 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0c5fde58-3efa-46fb-b03b-0aae018bc536 Jul 03 14:16:18 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:18 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b Jul 03 14:16:18 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:18 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b" returned: 0 in 0.835s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:18 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0c5fde58-3efa-46fb-b03b-0aae018bc536" returned: 0 in 0.768s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.304s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-822288780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4958170c-4f53-46eb-a401-6e7a2aa5fea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f4caaefa7e48a18e307fc06d16dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:13Z,use_quota=True,user_id='b41f99d601fc491d98c8e9aef3b6b94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Creating volume 4958170c-4f53-46eb-a401-6e7a2aa5fea0 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:18 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:18 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:16:18 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4958170c-4f53-46eb-a401-6e7a2aa5fea0 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45474fc-ba12-45ca-91e7-b640590a0b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c5fde58-3efa-46fb-b03b-0aae018bc536', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333a275f-2814-434a-a391-ea8e71c3ae20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:18 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4958170c-4f53-46eb-a401-6e7a2aa5fea0 1073741824 Jul 03 14:16:18 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:18 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume volume-0c5fde58-3efa-46fb-b03b-0aae018bc536 (0c5fde58-3efa-46fb-b03b-0aae018bc536): created successfully Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333a275f-2814-434a-a391-ea8e71c3ae20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Flow 'volume_create_manager' (b449ca7c-7493-4d5d-bca9-7069fbc8e8e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:19 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-90dfc584-db4d-4c09-a77e-dc5934de3c7c tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Created volume successfully. Jul 03 14:16:19 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b" returned: 0 in 0.811s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-quobyte-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b" released by "delete_volume" :: held 1.686s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:19 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] Created reservations ['f78efc73-25c7-4900-992a-68586ca96797', '3f11d759-2bc2-4648-a212-eb3cb6c21be2', 'fa956141-dbb3-4923-b50e-d0e83c55d844', 'f60d6b93-dc15-487b-80ca-1614dcc95bf3'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:16:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:19 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:16:19 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:20 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4958170c-4f53-46eb-a401-6e7a2aa5fea0 1073741824" returned: 0 in 1.098s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4958170c-4f53-46eb-a401-6e7a2aa5fea0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:20 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4958170c-4f53-46eb-a401-6e7a2aa5fea0 Jul 03 14:16:20 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "cinder-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "cinder-quobyte-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-quobyte-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cf7c0b-7e0a-455b-9b6f-6622c6cb819c]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:20 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124 Jul 03 14:16:20 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:20 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.807s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:20 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] Deleted volume successfully. Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f095f189-f3a2-4e17-bb42-232d5143ecb3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-2f5d5ccb-758c-4e5c-8c69-eee7fc70546b-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:20 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4958170c-4f53-46eb-a401-6e7a2aa5fea0" returned: 0 in 0.804s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1967644643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8f4766-48de-431b-aead-2dbfb4ac1412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f4caaefa7e48a18e307fc06d16dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:14Z,use_quota=True,user_id='b41f99d601fc491d98c8e9aef3b6b94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Creating volume 7f8f4766-48de-431b-aead-2dbfb4ac1412 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:16:20 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f8f4766-48de-431b-aead-2dbfb4ac1412 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89855d57-fcf5-43eb-a728-41dc6433ec1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4958170c-4f53-46eb-a401-6e7a2aa5fea0', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:20 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f8f4766-48de-431b-aead-2dbfb4ac1412 1073741824 Jul 03 14:16:20 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de41bde8-5525-4b0a-bdac-6af90439dd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:20 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume volume-4958170c-4f53-46eb-a401-6e7a2aa5fea0 (4958170c-4f53-46eb-a401-6e7a2aa5fea0): created successfully Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de41bde8-5525-4b0a-bdac-6af90439dd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Flow 'volume_create_manager' (383456e2-714f-4e17-a030-1897445a82d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:20 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-3b80a575-a290-4cd0-8de9-591894f26010 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Created volume successfully. Jul 03 14:16:21 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124" returned: 0 in 0.887s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:21 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124 Jul 03 14:16:21 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:21 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f8f4766-48de-431b-aead-2dbfb4ac1412 1073741824" returned: 0 in 1.033s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f8f4766-48de-431b-aead-2dbfb4ac1412 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:22 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f8f4766-48de-431b-aead-2dbfb4ac1412 Jul 03 14:16:22 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:22 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124" returned: 0 in 0.792s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-quobyte-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124" released by "delete_volume" :: held 1.744s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] Created reservations ['ce1f5760-7a59-4be3-b16f-07087976cd2a', '506980cf-a318-4311-9531-e1e857860e7f', '36f236e2-0cc3-4711-bfc1-566919d8d942', '6538863a-0dfd-420d-ab60-0fc165697709'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:22 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:16:22 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "cinder-b4bdcef3-0d6a-488a-8633-508fddd68bfd-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-b4bdcef3-0d6a-488a-8633-508fddd68bfd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:22 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f8f4766-48de-431b-aead-2dbfb4ac1412" returned: 0 in 0.712s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.298s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1796466868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27912ca2-0acd-4931-97f8-8b890ccce79b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f4caaefa7e48a18e307fc06d16dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:14Z,use_quota=True,user_id='b41f99d601fc491d98c8e9aef3b6b94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Creating volume 27912ca2-0acd-4931-97f8-8b890ccce79b {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:16:22 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-27912ca2-0acd-4931-97f8-8b890ccce79b 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "cinder-quobyte-b4bdcef3-0d6a-488a-8633-508fddd68bfd" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-quobyte-b4bdcef3-0d6a-488a-8633-508fddd68bfd" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:22 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-27912ca2-0acd-4931-97f8-8b890ccce79b 1073741824 Jul 03 14:16:22 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbee18d-6b4f-4b89-9dac-9670bfa4d137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f8f4766-48de-431b-aead-2dbfb4ac1412', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b1b0a6-25c7-4c0a-a786-88ba971a1f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cfaca6-0203-434f-8829-7bfbc882a120]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4bdcef3-0d6a-488a-8633-508fddd68bfd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:22 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume volume-7f8f4766-48de-431b-aead-2dbfb4ac1412 (7f8f4766-48de-431b-aead-2dbfb4ac1412): created successfully Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b1b0a6-25c7-4c0a-a786-88ba971a1f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Flow 'volume_create_manager' (7ef1bdc4-a426-4326-ab37-9f96cf52148c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:22 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-c9bd0675-31dd-4aac-a314-fe79b9072d42 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Created volume successfully. Jul 03 14:16:22 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4bdcef3-0d6a-488a-8633-508fddd68bfd Jul 03 14:16:22 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:23 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.869s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:23 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] Deleted volume successfully. Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Flow 'volume_create_manager' (bc3e4131-2f37-4d91-8d21-31f12b5d141b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6abee945-298f-4067-8c88-4f4018e687a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4e61928e-c597-40bf-9a92-0b68234a40e3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-3e4ff6eb-4f76-4896-b7bd-4e5f36b00124-delete_volume" released by "delete_volume" :: held 2.933s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6abee945-298f-4067-8c88-4f4018e687a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-764644260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e349c088-08dd-40cf-92ae-15e2e8d04782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6722f93563b945d2a6de0d1159babc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:23Z,use_quota=True,user_id='93b3239ca2f14c548ae9c14144e30ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279a1363-0380-4e61-9bd8-36e329b008a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279a1363-0380-4e61-9bd8-36e329b008a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708585fb-16ae-451a-a6a1-126d848b229e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708585fb-16ae-451a-a6a1-126d848b229e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e349c088-08dd-40cf-92ae-15e2e8d04782', 'volume_name': 'volume-e349c088-08dd-40cf-92ae-15e2e8d04782', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04876d2f-ba68-451f-bfd7-148c6417a230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04876d2f-ba68-451f-bfd7-148c6417a230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca80cc5-08dc-46ca-9969-e7f7d7a548bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:23 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Volume e349c088-08dd-40cf-92ae-15e2e8d04782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e349c088-08dd-40cf-92ae-15e2e8d04782', 'volume_size': 1} Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:23 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-27912ca2-0acd-4931-97f8-8b890ccce79b 1073741824" returned: 0 in 0.987s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-27912ca2-0acd-4931-97f8-8b890ccce79b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:23 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-27912ca2-0acd-4931-97f8-8b890ccce79b Jul 03 14:16:23 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:23 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4bdcef3-0d6a-488a-8633-508fddd68bfd" returned: 0 in 0.979s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4bdcef3-0d6a-488a-8633-508fddd68bfd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:23 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4bdcef3-0d6a-488a-8633-508fddd68bfd Jul 03 14:16:23 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:24 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b4bdcef3-0d6a-488a-8633-508fddd68bfd" returned: 0 in 0.701s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:24 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-27912ca2-0acd-4931-97f8-8b890ccce79b" returned: 0 in 0.756s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.635s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-442265812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf93fff6-4045-4002-8fd6-6976b1118855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f4caaefa7e48a18e307fc06d16dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:15Z,use_quota=True,user_id='b41f99d601fc491d98c8e9aef3b6b94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Creating volume cf93fff6-4045-4002-8fd6-6976b1118855 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:16:24 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cf93fff6-4045-4002-8fd6-6976b1118855 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-quobyte-b4bdcef3-0d6a-488a-8633-508fddd68bfd" released by "delete_volume" :: held 1.777s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:24 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cf93fff6-4045-4002-8fd6-6976b1118855 1073741824 Jul 03 14:16:24 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59382208-3220-43cd-80db-f30d9a46b54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27912ca2-0acd-4931-97f8-8b890ccce79b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a557165-e6ee-40c1-accf-5336f60cb600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:24 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume volume-27912ca2-0acd-4931-97f8-8b890ccce79b (27912ca2-0acd-4931-97f8-8b890ccce79b): created successfully Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a557165-e6ee-40c1-accf-5336f60cb600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Flow 'volume_create_manager' (6c2484b0-2bb6-4faf-8009-a12fe2e1b352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:24 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-bf9c9b87-34fa-410f-9aeb-0df95a2c46c6 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Created volume successfully. Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] Created reservations ['e14f8ad6-cb47-4688-b50c-b19106466842', '7cdb2023-a11a-4763-a90c-7e3064e9b5a4', '882e5907-b04f-4a93-b46d-51541ebd0665', 'c6cc001a-3a05-444a-a302-981f737318f3'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:24 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:16:24 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "cinder-9dfa926f-56d4-4561-a6be-ebfd9c3091be-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-9dfa926f-56d4-4561-a6be-ebfd9c3091be-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "cinder-quobyte-9dfa926f-56d4-4561-a6be-ebfd9c3091be" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-quobyte-9dfa926f-56d4-4561-a6be-ebfd9c3091be" acquired by "delete_volume" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[50971537-02ae-47af-b87f-4c784d451769]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9dfa926f-56d4-4561-a6be-ebfd9c3091be {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:25 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9dfa926f-56d4-4561-a6be-ebfd9c3091be Jul 03 14:16:25 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:25 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.728s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:25 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:25 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] Deleted volume successfully. Jul 03 14:16:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-596b5641-9887-40c7-b6f7-df5f4da963d3 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-b4bdcef3-0d6a-488a-8633-508fddd68bfd-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:25 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cf93fff6-4045-4002-8fd6-6976b1118855 1073741824" returned: 0 in 0.965s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cf93fff6-4045-4002-8fd6-6976b1118855 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:25 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cf93fff6-4045-4002-8fd6-6976b1118855 Jul 03 14:16:25 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:25 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9dfa926f-56d4-4561-a6be-ebfd9c3091be" returned: 0 in 0.923s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9dfa926f-56d4-4561-a6be-ebfd9c3091be {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:25 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9dfa926f-56d4-4561-a6be-ebfd9c3091be Jul 03 14:16:25 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:26 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cf93fff6-4045-4002-8fd6-6976b1118855" returned: 0 in 0.638s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.362s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ada150f-da58-4cf2-9e1b-235f6bf7c4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50118a3cefd14ba195e6f942e56e8518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:11Z,use_quota=True,user_id='ddb6a77d8880435da8b14f860964ba13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97983eb9-8a33-42ab-9b69-390ae209695a),volume_type_id=97983eb9-8a33-42ab-9b69-390ae209695a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Creating volume 7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:16:26 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:26 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 1073741824 Jul 03 14:16:26 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d77cf8-3e96-40cf-a90e-3dafe42a1e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf93fff6-4045-4002-8fd6-6976b1118855', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b32c3b5-b918-4f3a-9bbb-46a6e3be7711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:26 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Volume volume-cf93fff6-4045-4002-8fd6-6976b1118855 (cf93fff6-4045-4002-8fd6-6976b1118855): created successfully Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b32c3b5-b918-4f3a-9bbb-46a6e3be7711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Flow 'volume_create_manager' (d5b404d8-6aaf-47f9-b8a9-fc3241f1d755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:26 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-fe54fe42-7fe0-4caf-9edb-fb4feb03062a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Created volume successfully. Jul 03 14:16:26 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-9dfa926f-56d4-4561-a6be-ebfd9c3091be" returned: 0 in 0.678s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-quobyte-9dfa926f-56d4-4561-a6be-ebfd9c3091be" released by "delete_volume" :: held 1.651s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] Created reservations ['f051dd34-c412-4c58-8906-5e7aa2e8ba56', '08db8e48-2d43-4f90-a3ad-366d032827bb', 'a55372ce-8497-46ce-9167-c6acccdf64d4', '1155270a-2d4d-4a94-a7c8-d8c3ffb65525'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "cinder-cf93fff6-4045-4002-8fd6-6976b1118855-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-cf93fff6-4045-4002-8fd6-6976b1118855-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:26 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:16:26 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "cinder-quobyte-cf93fff6-4045-4002-8fd6-6976b1118855" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-quobyte-cf93fff6-4045-4002-8fd6-6976b1118855" acquired by "delete_volume" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[05991d3c-30a5-4929-9a2e-54a742886c0d]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cf93fff6-4045-4002-8fd6-6976b1118855 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:27 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cf93fff6-4045-4002-8fd6-6976b1118855 Jul 03 14:16:27 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "cinder-185ab22a-3143-4b23-950b-83475dfbd20a-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-185ab22a-3143-4b23-950b-83475dfbd20a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:27 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 1073741824" returned: 0 in 1.082s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "cinder-quobyte-185ab22a-3143-4b23-950b-83475dfbd20a" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-quobyte-185ab22a-3143-4b23-950b-83475dfbd20a" acquired by "delete_volume" :: waited 0.026s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:27 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1d9158-6a46-4fb4-9de6-0b66382acb6e]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-185ab22a-3143-4b23-950b-83475dfbd20a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:27 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 Jul 03 14:16:27 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:27 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-185ab22a-3143-4b23-950b-83475dfbd20a Jul 03 14:16:27 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:27 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.808s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:27 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:27 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] Deleted volume successfully. Jul 03 14:16:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4422bb9a-8506-44c3-bbb1-eefed00f68ae tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-9dfa926f-56d4-4561-a6be-ebfd9c3091be-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:27 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cf93fff6-4045-4002-8fd6-6976b1118855" returned: 0 in 0.979s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cf93fff6-4045-4002-8fd6-6976b1118855 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:27 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cf93fff6-4045-4002-8fd6-6976b1118855 Jul 03 14:16:27 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:28 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3" returned: 0 in 0.744s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.713s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-764644260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e349c088-08dd-40cf-92ae-15e2e8d04782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6722f93563b945d2a6de0d1159babc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:23Z,use_quota=True,user_id='93b3239ca2f14c548ae9c14144e30ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Creating volume e349c088-08dd-40cf-92ae-15e2e8d04782 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:16:28 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e349c088-08dd-40cf-92ae-15e2e8d04782 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:28 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e349c088-08dd-40cf-92ae-15e2e8d04782 1073741824 Jul 03 14:16:28 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Attempting download of 2bef5a29-a7d4-411d-afab-59757d740fa1 ((None, [{'url': 'file:///opt/stack/data/glance/images/2bef5a29-a7d4-411d-afab-59757d740fa1', 'metadata': {}}])) to volume 7ada150f-da58-4cf2-9e1b-235f6bf7c4d3. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[481fc3ab-1e7f-4c3f-8026-2e2d65c385da]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2bef5a29-a7d4-411d-afab-59757d740fa1_x681g7vl {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:28 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-185ab22a-3143-4b23-950b-83475dfbd20a" returned: 0 in 0.877s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-185ab22a-3143-4b23-950b-83475dfbd20a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:28 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-185ab22a-3143-4b23-950b-83475dfbd20a Jul 03 14:16:28 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:28 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2bef5a29-a7d4-411d-afab-59757d740fa1_x681g7vl Jul 03 14:16:28 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:28 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-cf93fff6-4045-4002-8fd6-6976b1118855" returned: 0 in 0.758s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-quobyte-cf93fff6-4045-4002-8fd6-6976b1118855" released by "delete_volume" :: held 1.787s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Created reservations ['98d8e47b-e955-49f8-a907-4dcc75e1c249', '04045d7c-a29c-411c-a012-a301bca5841f', 'cf06e4dd-7b2c-4f74-a9d6-77255c9e361a', '1e2dc815-78bf-460d-b879-3b2c08e11454'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:28 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:16:28 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:29 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-185ab22a-3143-4b23-950b-83475dfbd20a" returned: 0 in 0.826s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-quobyte-185ab22a-3143-4b23-950b-83475dfbd20a" released by "delete_volume" :: held 1.770s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:29 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "cinder-27912ca2-0acd-4931-97f8-8b890ccce79b-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2bef5a29-a7d4-411d-afab-59757d740fa1_x681g7vl" returned: 0 in 0.910s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bef5a29-a7d4-411d-afab-59757d740fa1_x681g7vl {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:29 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-27912ca2-0acd-4931-97f8-8b890ccce79b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e349c088-08dd-40cf-92ae-15e2e8d04782 1073741824" returned: 0 in 1.082s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "cinder-quobyte-27912ca2-0acd-4931-97f8-8b890ccce79b" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e349c088-08dd-40cf-92ae-15e2e8d04782 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:29 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bef5a29-a7d4-411d-afab-59757d740fa1_x681g7vl Jul 03 14:16:29 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-quobyte-27912ca2-0acd-4931-97f8-8b890ccce79b" acquired by "delete_volume" :: waited 0.056s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:29 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e349c088-08dd-40cf-92ae-15e2e8d04782 Jul 03 14:16:29 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] Created reservations ['3adf7cf4-afb4-4199-9c43-bba1c0201634', '853c0d99-961f-423e-bfc8-858aff4771de', 'f7f38ed0-e71c-47b2-ab29-62e7315fe650', '4fa825b4-f3da-4f6c-8a47-bc65d73abf76'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffffe63-f4bf-427a-b499-2913dfda309c]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-27912ca2-0acd-4931-97f8-8b890ccce79b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:29 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:16:29 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:29 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-27912ca2-0acd-4931-97f8-8b890ccce79b Jul 03 14:16:29 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:29 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.029s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:29 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Deleted volume successfully. Jul 03 14:16:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ac3a952c-1980-4915-899a-df858b8067c8 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-cf93fff6-4045-4002-8fd6-6976b1118855-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:30 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bef5a29-a7d4-411d-afab-59757d740fa1_x681g7vl" returned: 1 in 1.141s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bef5a29-a7d4-411d-afab-59757d740fa1_x681g7vl' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:16:30 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[343d8606-640c-4d5c-83bf-0f663874298b]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:30 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:30 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD Jul 03 14:16:30 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.959s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:30 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:30 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] Deleted volume successfully. Jul 03 14:16:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-10f983fa-204a-4541-a552-65a27d3dc440 tempest-CreateVolumesFromImageTest-1634063876 None] Lock "cinder-185ab22a-3143-4b23-950b-83475dfbd20a-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:30 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:30 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e349c088-08dd-40cf-92ae-15e2e8d04782" returned: 0 in 1.293s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:30 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] <== create_volume: return (2453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:16:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.457s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-27912ca2-0acd-4931-97f8-8b890ccce79b" returned: 0 in 1.226s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-27912ca2-0acd-4931-97f8-8b890ccce79b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca80cc5-08dc-46ca-9969-e7f7d7a548bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e349c088-08dd-40cf-92ae-15e2e8d04782', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d71abf-bf9b-48af-b91c-2d5db786548a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:30 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-27912ca2-0acd-4931-97f8-8b890ccce79b Jul 03 14:16:30 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:30 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Volume volume-e349c088-08dd-40cf-92ae-15e2e8d04782 (e349c088-08dd-40cf-92ae-15e2e8d04782): created successfully Jul 03 14:16:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d71abf-bf9b-48af-b91c-2d5db786548a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Flow 'volume_create_manager' (bc3e4131-2f37-4d91-8d21-31f12b5d141b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:30 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-21cb5e82-29fb-4dc1-b584-2ae9103f5b8f tempest-ProjectReaderTests-1746015782 None] Created volume successfully. Jul 03 14:16:31 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD" returned: 0 in 0.940s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] Acquiring lock "cinder-e349c088-08dd-40cf-92ae-15e2e8d04782-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] Lock "cinder-e349c088-08dd-40cf-92ae-15e2e8d04782-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] Acquiring lock "cinder-quobyte-e349c088-08dd-40cf-92ae-15e2e8d04782" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] Lock "cinder-quobyte-e349c088-08dd-40cf-92ae-15e2e8d04782" acquired by "delete_volume" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:31 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4475f7-132d-48be-9392-ebf443fc0474]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e349c088-08dd-40cf-92ae-15e2e8d04782 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:31 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD Jul 03 14:16:31 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:31 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-27912ca2-0acd-4931-97f8-8b890ccce79b" returned: 0 in 0.890s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-quobyte-27912ca2-0acd-4931-97f8-8b890ccce79b" released by "delete_volume" :: held 2.188s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:31 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Created reservations ['096bb98f-06d5-40e2-83a5-8c76e6f3b571', 'a3984708-bc5c-462f-a32e-284963f26ac1', 'e093535d-5a4f-4da5-a2e3-fe14efe03012', 'b28eedcd-c8e3-4b07-915a-8004d174fd08'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:16:31 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e349c088-08dd-40cf-92ae-15e2e8d04782 Jul 03 14:16:31 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:31 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:16:31 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:32 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD" returned: 1 in 1.057s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:16:32 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] 2bef5a29-a7d4-411d-afab-59757d740fa1 was raw, converting to raw {{(pid=86805) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 14:16:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:32 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 Jul 03 14:16:32 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:32 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e349c088-08dd-40cf-92ae-15e2e8d04782" returned: 0 in 1.017s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e349c088-08dd-40cf-92ae-15e2e8d04782 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:32 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e349c088-08dd-40cf-92ae-15e2e8d04782 Jul 03 14:16:32 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "cinder-7f8f4766-48de-431b-aead-2dbfb4ac1412-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-7f8f4766-48de-431b-aead-2dbfb4ac1412-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:32 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.945s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:32 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:32 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Deleted volume successfully. Jul 03 14:16:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "cinder-quobyte-7f8f4766-48de-431b-aead-2dbfb4ac1412" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-quobyte-7f8f4766-48de-431b-aead-2dbfb4ac1412" acquired by "delete_volume" :: waited 0.023s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-33d13ecc-9b29-4fd9-8e86-e8734b1f115a tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-27912ca2-0acd-4931-97f8-8b890ccce79b-delete_volume" released by "delete_volume" :: held 3.549s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:32 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f6ba91-736a-4a1e-acca-ce82d59fb290]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f8f4766-48de-431b-aead-2dbfb4ac1412 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:32 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f8f4766-48de-431b-aead-2dbfb4ac1412 Jul 03 14:16:32 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:33 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3" returned: 0 in 1.079s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:33 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2bef5a29-a7d4-411d-afab-59757d740fa1_vooeon0adevstack@QuobyteHD, size 0.00 MB, duration 1.08 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:16:33 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 14:16:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:33 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e349c088-08dd-40cf-92ae-15e2e8d04782" returned: 0 in 0.965s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:33 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 1G Jul 03 14:16:33 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] Lock "cinder-quobyte-e349c088-08dd-40cf-92ae-15e2e8d04782" released by "delete_volume" :: held 2.037s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:33 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] Created reservations ['0e0b192e-63aa-4383-b42d-86574364b9ed', 'f50e7d31-59ea-482a-8a73-edfe3ac15a25', 'f43538a1-81e7-406c-bb48-0366189c54b6', '730c7464-c362-4577-bf06-9c4e4f5cd66e'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:16:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:33 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:16:33 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:33 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f8f4766-48de-431b-aead-2dbfb4ac1412" returned: 0 in 1.046s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f8f4766-48de-431b-aead-2dbfb4ac1412 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:33 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f8f4766-48de-431b-aead-2dbfb4ac1412 Jul 03 14:16:33 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:34 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 1G" returned: 0 in 0.789s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:34 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a850319-d608-40aa-91c0-c02010061c51]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:34 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 Jul 03 14:16:34 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:34 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.801s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:34 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] Deleted volume successfully. Jul 03 14:16:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9e26006a-de03-4a07-a233-edfedf280709 tempest-ProjectReaderTests-1746015782 None] Lock "cinder-e349c088-08dd-40cf-92ae-15e2e8d04782-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:34 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f8f4766-48de-431b-aead-2dbfb4ac1412" returned: 0 in 0.869s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-quobyte-7f8f4766-48de-431b-aead-2dbfb4ac1412" released by "delete_volume" :: held 1.963s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:34 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Created reservations ['fec35956-5790-4f30-b79c-4a11f3d061c4', '64c4dd70-e3e4-4f3b-bebf-15fb748b211a', '5f0fcba1-f13e-4fb9-a6d7-927adbd2e083', '0c1d21d4-db1b-499a-8a43-4e2acf9e82b4'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:16:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:34 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:16:34 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "cinder-4958170c-4f53-46eb-a401-6e7a2aa5fea0-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-4958170c-4f53-46eb-a401-6e7a2aa5fea0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "cinder-quobyte-4958170c-4f53-46eb-a401-6e7a2aa5fea0" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-quobyte-4958170c-4f53-46eb-a401-6e7a2aa5fea0" acquired by "delete_volume" :: waited 0.030s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c5316c-06d2-465d-a876-3fbeb6ba8111]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4958170c-4f53-46eb-a401-6e7a2aa5fea0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:35 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3" returned: 0 in 1.013s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:35 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4958170c-4f53-46eb-a401-6e7a2aa5fea0 Jul 03 14:16:35 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:35 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 Jul 03 14:16:35 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Flow 'volume_create_manager' (c5cb79e0-a507-4476-af76-ea63891cc7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db596b3-6c88-4146-a5c9-e33ab3652a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db596b3-6c88-4146-a5c9-e33ab3652a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-520656124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57720f09-6bab-4e1f-8cca-88e3e8028b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6722f93563b945d2a6de0d1159babc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:35Z,use_quota=True,user_id='93b3239ca2f14c548ae9c14144e30ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc80a76-2a4f-45aa-b864-af310167b63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc80a76-2a4f-45aa-b864-af310167b63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56dd187f-57e0-4e30-b0b2-121aa604b5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56dd187f-57e0-4e30-b0b2-121aa604b5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57720f09-6bab-4e1f-8cca-88e3e8028b03', 'volume_name': 'volume-57720f09-6bab-4e1f-8cca-88e3e8028b03', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0b4340-4118-4fd2-b999-217887cb5d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0b4340-4118-4fd2-b999-217887cb5d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9635950d-797f-4f93-9545-9898899227fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:35 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Volume 57720f09-6bab-4e1f-8cca-88e3e8028b03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57720f09-6bab-4e1f-8cca-88e3e8028b03', 'volume_size': 1} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-520656124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57720f09-6bab-4e1f-8cca-88e3e8028b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6722f93563b945d2a6de0d1159babc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:35Z,use_quota=True,user_id='93b3239ca2f14c548ae9c14144e30ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Creating volume 57720f09-6bab-4e1f-8cca-88e3e8028b03 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:16:35 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-57720f09-6bab-4e1f-8cca-88e3e8028b03 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:35 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-57720f09-6bab-4e1f-8cca-88e3e8028b03 1073741824 Jul 03 14:16:35 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:35 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.889s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:35 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Deleted volume successfully. Jul 03 14:16:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-ffd3b1a4-f500-4109-9fe6-007274a0ff5f tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-7f8f4766-48de-431b-aead-2dbfb4ac1412-delete_volume" released by "delete_volume" :: held 3.201s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:36 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3" returned: 1 in 1.036s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:16:36 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Downloaded image 2bef5a29-a7d4-411d-afab-59757d740fa1 ((None, [{'url': 'file:///opt/stack/data/glance/images/2bef5a29-a7d4-411d-afab-59757d740fa1', 'metadata': {}}])) to volume 7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 successfully. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 14:16:36 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:36 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Temporary image 2bef5a29-a7d4-411d-afab-59757d740fa1 for user ddb6a77d8880435da8b14f860964ba13 is deleted. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 14:16:36 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Marking volume 7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 as bootable. {{(pid=86805) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 14:16:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4958170c-4f53-46eb-a401-6e7a2aa5fea0" returned: 0 in 1.157s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4958170c-4f53-46eb-a401-6e7a2aa5fea0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:36 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Copying metadata from image 2bef5a29-a7d4-411d-afab-59757d740fa1 to 7ada150f-da58-4cf2-9e1b-235f6bf7c4d3. {{(pid=86805) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 14:16:36 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Creating volume glance metadata for volume 7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 backed by image 2bef5a29-a7d4-411d-afab-59757d740fa1 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2bef5a29-a7d4-411d-afab-59757d740fa1', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b02a9197d1535f4c489c9c303ce307eb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86805) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 14:16:36 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4958170c-4f53-46eb-a401-6e7a2aa5fea0 Jul 03 14:16:36 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d4c00f-1b5c-45ac-93dc-530371a1e7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3', 'volume_size': 1, 'image_id': '2bef5a29-a7d4-411d-afab-59757d740fa1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bef5a29-a7d4-411d-afab-59757d740fa1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b02a9197d1535f4c489c9c303ce307eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '50118a3cefd14ba195e6f942e56e8518', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e0c81a9e6128f622bcf0fa8b63902d663426780cbf5e5f96cf36e3848ecfadc33b01fbf7269dc3d070e82b2be0bebc8891673eac8a240c12f3a6ca1e640049e', 'id': '2bef5a29-a7d4-411d-afab-59757d740fa1', 'created_at': datetime.datetime(2026, 7, 3, 12, 16, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 16, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bef5a29-a7d4-411d-afab-59757d740fa1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772d00cc-daa1-47ca-8ce2-986061f07a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:36 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Volume volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 (7ada150f-da58-4cf2-9e1b-235f6bf7c4d3): created successfully Jul 03 14:16:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772d00cc-daa1-47ca-8ce2-986061f07a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:36 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Flow 'volume_create_manager' (6247e481-78d1-4743-9d54-839587eeab5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:36 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-8080e62b-e2d2-431c-a05f-34536ad46365 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Created volume successfully. Jul 03 14:16:36 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-57720f09-6bab-4e1f-8cca-88e3e8028b03 1073741824" returned: 0 in 1.066s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-57720f09-6bab-4e1f-8cca-88e3e8028b03 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:36 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-57720f09-6bab-4e1f-8cca-88e3e8028b03 Jul 03 14:16:36 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:36 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4958170c-4f53-46eb-a401-6e7a2aa5fea0" returned: 0 in 0.706s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-quobyte-4958170c-4f53-46eb-a401-6e7a2aa5fea0" released by "delete_volume" :: held 1.921s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Created reservations ['5ac3ee72-bd32-4b69-b0ff-a57c70f70377', 'ca10c52a-40eb-44c8-bacf-49d1f9c3784b', '81a0cceb-2fb2-4791-a559-c3e3ca4dfaef', '21d0e73d-e61a-4a48-a33b-ba2639be5b13'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:37 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:16:37 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "cinder-0c5fde58-3efa-46fb-b03b-0aae018bc536-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-0c5fde58-3efa-46fb-b03b-0aae018bc536-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "cinder-quobyte-0c5fde58-3efa-46fb-b03b-0aae018bc536" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-quobyte-0c5fde58-3efa-46fb-b03b-0aae018bc536" acquired by "delete_volume" :: waited 0.031s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb76634-f8c7-4e09-ac90-cbe5435827f3]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0c5fde58-3efa-46fb-b03b-0aae018bc536 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Acquiring lock "cinder-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:37 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Flow 'volume_create_manager' (93f842ca-9e35-4b06-8e7b-31ebbfb64d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c45548-853c-4452-a74d-55610aec72af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-57720f09-6bab-4e1f-8cca-88e3e8028b03" returned: 0 in 0.984s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Lock "cinder-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c45548-853c-4452-a74d-55610aec72af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35918ed0-8996-4dad-8351-0de80e091687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4573813438c411d98b46d07750c8cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:37Z,use_quota=True,user_id='3d50c878d52b4d2fb7320a813559c461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8c082d-5334-4eaa-b1f5-5380d4db0d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8c082d-5334-4eaa-b1f5-5380d4db0d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ea5249-9260-4ed1-ba48-63720303e948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.image.glance [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Creating Keystone auth plugin from conf {{(pid=86805) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9635950d-797f-4f93-9545-9898899227fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57720f09-6bab-4e1f-8cca-88e3e8028b03', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177eca06-e1d1-4905-a5be-bb6b74222277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:37 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0c5fde58-3efa-46fb-b03b-0aae018bc536 Jul 03 14:16:37 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:37 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Volume volume-57720f09-6bab-4e1f-8cca-88e3e8028b03 (57720f09-6bab-4e1f-8cca-88e3e8028b03): created successfully Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177eca06-e1d1-4905-a5be-bb6b74222277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Flow 'volume_create_manager' (c5cb79e0-a507-4476-af76-ea63891cc7be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Acquiring lock "cinder-quobyte-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:37 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-2c6b7c21-c710-47c7-93df-ec00687913a9 tempest-ProjectReaderTests-1746015782 None] Created volume successfully. Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Lock "cinder-quobyte-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3" acquired by "delete_volume" :: waited 0.030s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba77a86-b40e-44e7-9b79-da0f125bcdc7]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:37 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 Jul 03 14:16:37 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:37 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ea5249-9260-4ed1-ba48-63720303e948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '35918ed0-8996-4dad-8351-0de80e091687', 'volume_name': 'volume-35918ed0-8996-4dad-8351-0de80e091687', 'volume_size': 1, 'image_id': '25bbcef6-4e47-4c37-aec0-334ff22b7737', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25bbcef6-4e47-4c37-aec0-334ff22b7737', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ee64bb933bc387d3e113752fef2c5251', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a4573813438c411d98b46d07750c8cff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c2f4d2e6aa21e603eb43348c895189a10c1dfbb92ff7c8f2fb1a82f2cf2861ea6771851d5f940bc2790de8f9fce086c12802cf5373bc235c4c4f8354cfec8fa', 'id': '25bbcef6-4e47-4c37-aec0-334ff22b7737', 'created_at': datetime.datetime(2026, 7, 3, 12, 16, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 16, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25bbcef6-4e47-4c37-aec0-334ff22b7737/file', 'properties': {}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f9287d-191c-495c-b973-377bd2656a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f9287d-191c-495c-b973-377bd2656a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d5cbbd-e517-4f75-8b82-e598d7b50ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:37 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Volume 35918ed0-8996-4dad-8351-0de80e091687: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-35918ed0-8996-4dad-8351-0de80e091687', 'volume_size': 1, 'image_id': '25bbcef6-4e47-4c37-aec0-334ff22b7737', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25bbcef6-4e47-4c37-aec0-334ff22b7737', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ee64bb933bc387d3e113752fef2c5251', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a4573813438c411d98b46d07750c8cff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c2f4d2e6aa21e603eb43348c895189a10c1dfbb92ff7c8f2fb1a82f2cf2861ea6771851d5f940bc2790de8f9fce086c12802cf5373bc235c4c4f8354cfec8fa', 'id': '25bbcef6-4e47-4c37-aec0-334ff22b7737', 'created_at': datetime.datetime(2026, 7, 3, 12, 16, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 16, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25bbcef6-4e47-4c37-aec0-334ff22b7737/file', 'properties': {}}, 'image_service': } Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Trying to clone 35918ed0-8996-4dad-8351-0de80e091687 from image 25bbcef6-4e47-4c37-aec0-334ff22b7737 at location (None, [{'url': 'file:///opt/stack/data/glance/images/25bbcef6-4e47-4c37-aec0-334ff22b7737', 'metadata': {}}]). {{(pid=86805) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.891s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:37 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:37 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Deleted volume successfully. Jul 03 14:16:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-92f99ef9-c6aa-4423-b457-d919148d9c57 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-4958170c-4f53-46eb-a401-6e7a2aa5fea0-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:38 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 14:16:38 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Image download 0.00 MB at 0.00 MB/s Jul 03 14:16:38 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daacb1a-4a4f-4b0f-863b-55875b43e89f]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:38 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD Jul 03 14:16:38 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:38 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0c5fde58-3efa-46fb-b03b-0aae018bc536" returned: 0 in 1.048s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0c5fde58-3efa-46fb-b03b-0aae018bc536 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:38 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0c5fde58-3efa-46fb-b03b-0aae018bc536 Jul 03 14:16:38 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:38 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3" returned: 0 in 0.886s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] Acquiring lock "cinder-57720f09-6bab-4e1f-8cca-88e3e8028b03-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] Lock "cinder-57720f09-6bab-4e1f-8cca-88e3e8028b03-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:38 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 Jul 03 14:16:38 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] Acquiring lock "cinder-quobyte-57720f09-6bab-4e1f-8cca-88e3e8028b03" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] Lock "cinder-quobyte-57720f09-6bab-4e1f-8cca-88e3e8028b03" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:38 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[16412c41-8c6b-434b-aac3-363bade1a732]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-57720f09-6bab-4e1f-8cca-88e3e8028b03 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:38 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD" returned: 0 in 0.808s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:39 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-57720f09-6bab-4e1f-8cca-88e3e8028b03 Jul 03 14:16:39 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:39 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD Jul 03 14:16:39 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:39 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-0c5fde58-3efa-46fb-b03b-0aae018bc536" returned: 0 in 0.967s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-quobyte-0c5fde58-3efa-46fb-b03b-0aae018bc536" released by "delete_volume" :: held 2.110s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:39 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3" returned: 1 in 0.872s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:16:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:39 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3 Jul 03 14:16:39 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:39 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Created reservations ['f9ff738e-0955-457e-84f2-128a781a7b72', 'e8ceff72-0e55-47dc-8cae-f41d8a096b8e', '9b1a51ca-c80e-44fa-aa29-c67e9acb7fa4', '8bacb10b-7f43-4771-87cf-0a9a35646e79'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:16:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:39 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:16:39 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:39 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-57720f09-6bab-4e1f-8cca-88e3e8028b03" returned: 0 in 0.887s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-57720f09-6bab-4e1f-8cca-88e3e8028b03 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:39 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-57720f09-6bab-4e1f-8cca-88e3e8028b03 Jul 03 14:16:39 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:39 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD" returned: 1 in 1.045s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:16:39 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Temporary image 25bbcef6-4e47-4c37-aec0-334ff22b7737 is fetched for user 3d50c878d52b4d2fb7320a813559c461. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b80ff4-a683-42a0-85f7-3416a3002bd8]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:40 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD Jul 03 14:16:40 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:40 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3" returned: 0 in 0.744s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Lock "cinder-quobyte-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3" released by "delete_volume" :: held 2.579s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Created reservations ['b101139c-da79-48e1-bfa5-3def156e3c20', '954e3bab-e2ef-4ae1-bd34-e7d1b1b0c2a5', 'bf1548d7-c98d-4d58-a4d4-bb5e6c25efb6', 'd657176f-675f-4543-b43f-6d5e5c0e6f27'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:40 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.807s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:40 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Deleted volume successfully. Jul 03 14:16:40 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:16:40 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:40 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f37b7c60-685c-445d-8f50-ae896140f051 tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-0c5fde58-3efa-46fb-b03b-0aae018bc536-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-57720f09-6bab-4e1f-8cca-88e3e8028b03" returned: 0 in 0.804s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] Lock "cinder-quobyte-57720f09-6bab-4e1f-8cca-88e3e8028b03" released by "delete_volume" :: held 1.745s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] Created reservations ['3a49c700-381a-4568-9890-f959d0311a0a', 'dd90de77-9ccf-4257-9710-24a9c80d5f30', 'bc20cf81-6d85-4716-b87e-38246d0d72e0', '1594de86-0dae-4c66-af69-450b079f56d5'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "cinder-7f04c31a-2846-42b0-98df-fbddfa952d1b-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-7f04c31a-2846-42b0-98df-fbddfa952d1b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "cinder-quobyte-7f04c31a-2846-42b0-98df-fbddfa952d1b" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-quobyte-7f04c31a-2846-42b0-98df-fbddfa952d1b" acquired by "delete_volume" :: waited 0.033s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1098ff9-7c56-4033-ae35-9694cb84f4b1]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f04c31a-2846-42b0-98df-fbddfa952d1b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:40 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:16:40 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:41 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f04c31a-2846-42b0-98df-fbddfa952d1b Jul 03 14:16:41 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:41 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD" returned: 0 in 1.028s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:41 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD Jul 03 14:16:41 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:41 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.140s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:41 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:41 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Deleted volume successfully. Jul 03 14:16:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9c3a3006-6385-454b-adf4-93c241943278 tempest-VolumeAndVolumeTypeFromImageTest-1500032064 None] Lock "cinder-7ada150f-da58-4cf2-9e1b-235f6bf7c4d3-delete_volume" released by "delete_volume" :: held 4.092s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:41 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.165s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:41 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:41 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] Deleted volume successfully. Jul 03 14:16:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0dc1e551-7575-4199-9660-c5caffbc49f9 tempest-ProjectReaderTests-1746015782 None] Lock "cinder-57720f09-6bab-4e1f-8cca-88e3e8028b03-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:42 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f04c31a-2846-42b0-98df-fbddfa952d1b" returned: 0 in 1.261s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f04c31a-2846-42b0-98df-fbddfa952d1b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:42 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f04c31a-2846-42b0-98df-fbddfa952d1b Jul 03 14:16:42 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:42 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD" returned: 1 in 1.093s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:16:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35918ed0-8996-4dad-8351-0de80e091687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4573813438c411d98b46d07750c8cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:37Z,use_quota=True,user_id='3d50c878d52b4d2fb7320a813559c461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:16:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Creating volume 35918ed0-8996-4dad-8351-0de80e091687 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:16:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:16:42 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:16:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:42 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 1073741824 Jul 03 14:16:42 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:43 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7f04c31a-2846-42b0-98df-fbddfa952d1b" returned: 0 in 0.941s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-quobyte-7f04c31a-2846-42b0-98df-fbddfa952d1b" released by "delete_volume" :: held 2.277s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:43 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Created reservations ['b5c752eb-2b3d-42eb-9fb8-eb41c702b1ae', '936ab824-7189-4fc3-ba4f-bc6a39bb1cdb', 'e9d7bbaf-ac9a-422c-92d5-b379f651f787', 'be50b51d-745e-486c-982e-9cf7304321cd'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:16:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:43 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:16:43 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:43 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 1073741824" returned: 0 in 1.166s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:43 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 Jul 03 14:16:43 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:44 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.778s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:44 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:44 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Deleted volume successfully. Jul 03 14:16:44 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5b04242e-9223-4194-83b9-1a7a06fb8baf tempest-CreateVolumesFromSourceVolumeTest-976616154 None] Lock "cinder-7f04c31a-2846-42b0-98df-fbddfa952d1b-delete_volume" released by "delete_volume" :: held 3.388s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:44 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687" returned: 0 in 0.973s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] <== create_volume: return (2211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:16:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.214s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:44 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Attempting download of 25bbcef6-4e47-4c37-aec0-334ff22b7737 ((None, [{'url': 'file:///opt/stack/data/glance/images/25bbcef6-4e47-4c37-aec0-334ff22b7737', 'metadata': {}}])) to volume 35918ed0-8996-4dad-8351-0de80e091687. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 14:16:44 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb649b4b-7d01-4c72-be7c-811a8daa16ce]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25bbcef6-4e47-4c37-aec0-334ff22b7737_crctgeye {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:44 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25bbcef6-4e47-4c37-aec0-334ff22b7737_crctgeye Jul 03 14:16:44 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:45 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25bbcef6-4e47-4c37-aec0-334ff22b7737_crctgeye" returned: 0 in 1.159s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25bbcef6-4e47-4c37-aec0-334ff22b7737_crctgeye {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:45 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25bbcef6-4e47-4c37-aec0-334ff22b7737_crctgeye Jul 03 14:16:45 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:46 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25bbcef6-4e47-4c37-aec0-334ff22b7737_crctgeye" returned: 1 in 1.027s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25bbcef6-4e47-4c37-aec0-334ff22b7737_crctgeye' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:16:46 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaef32c-a0ae-4c4b-9e8b-afc0da7c8282]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:46 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD Jul 03 14:16:46 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Flow 'volume_create_manager' (a5988712-5d13-4aba-af88-8cc99774cc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e88ddcb7-2aee-4639-ac3e-6f6c3e3f0c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e88ddcb7-2aee-4639-ac3e-6f6c3e3f0c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2011130028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6086724-5b4c-4035-b5bf-a6deaca23312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f89bde39af4e499456e9e7ff9a6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:48Z,use_quota=True,user_id='9173a23853f642a7bfea37e19a3e63e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db1e865-2ba4-4c71-b46d-1be847069c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db1e865-2ba4-4c71-b46d-1be847069c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c77cc4-8f59-4ad6-bbfa-4013fae9f9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c77cc4-8f59-4ad6-bbfa-4013fae9f9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6086724-5b4c-4035-b5bf-a6deaca23312', 'volume_name': 'volume-b6086724-5b4c-4035-b5bf-a6deaca23312', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9f7e22-97b8-48f6-ac5a-ecda9c47e90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9f7e22-97b8-48f6-ac5a-ecda9c47e90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27e8297-2e80-490d-ae6e-174a995f9bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:47 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume b6086724-5b4c-4035-b5bf-a6deaca23312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6086724-5b4c-4035-b5bf-a6deaca23312', 'volume_size': 1} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2011130028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6086724-5b4c-4035-b5bf-a6deaca23312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f89bde39af4e499456e9e7ff9a6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:48Z,use_quota=True,user_id='9173a23853f642a7bfea37e19a3e63e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:16:47 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Creating volume b6086724-5b4c-4035-b5bf-a6deaca23312 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:16:47 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD" returned: 0 in 1.049s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:47 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312 1073741824 Jul 03 14:16:47 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:47 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD Jul 03 14:16:47 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Flow 'volume_create_manager' (b051395c-d825-4fd9-a1d9-646398f1f5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2992206f-4196-4aab-8350-1cd4b8293e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2992206f-4196-4aab-8350-1cd4b8293e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1981515268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac75a4a5-ff06-419a-993a-9d74fad73635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b373ad6d5494f1e8fcbe93457b360b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:49Z,use_quota=True,user_id='dab98dc701354a8e910ea948045e6f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c78a4c9-c968-411e-9a43-6d781ad13c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c78a4c9-c968-411e-9a43-6d781ad13c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfcebfb-edcb-436d-a0cd-762e130d5c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfcebfb-edcb-436d-a0cd-762e130d5c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac75a4a5-ff06-419a-993a-9d74fad73635', 'volume_name': 'volume-ac75a4a5-ff06-419a-993a-9d74fad73635', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1a511e-c9b3-44dd-b775-c77ce2ac3a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1a511e-c9b3-44dd-b775-c77ce2ac3a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02d8fcd-c864-4bf0-a398-4c9137832716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:48 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Volume ac75a4a5-ff06-419a-993a-9d74fad73635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac75a4a5-ff06-419a-993a-9d74fad73635', 'volume_size': 1} Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:48 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD" returned: 1 in 1.002s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] 25bbcef6-4e47-4c37-aec0-334ff22b7737 was raw, converting to raw {{(pid=86805) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:48 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 Jul 03 14:16:48 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:48 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312 1073741824" returned: 0 in 1.096s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:48 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312 Jul 03 14:16:48 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:49 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687" returned: 0 in 0.887s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25bbcef6-4e47-4c37-aec0-334ff22b7737_gq6ipy3adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:16:49 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:49 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312" returned: 0 in 0.807s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.019s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1981515268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac75a4a5-ff06-419a-993a-9d74fad73635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b373ad6d5494f1e8fcbe93457b360b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:49Z,use_quota=True,user_id='dab98dc701354a8e910ea948045e6f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Creating volume ac75a4a5-ff06-419a-993a-9d74fad73635 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:16:49 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 1G Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:49 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:16:49 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:49 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 1073741824 Jul 03 14:16:49 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27e8297-2e80-490d-ae6e-174a995f9bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6086724-5b4c-4035-b5bf-a6deaca23312', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b45eb2-123c-4920-bc71-547c11dc4f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:49 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume volume-b6086724-5b4c-4035-b5bf-a6deaca23312 (b6086724-5b4c-4035-b5bf-a6deaca23312): created successfully Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b45eb2-123c-4920-bc71-547c11dc4f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:49 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Flow 'volume_create_manager' (a5988712-5d13-4aba-af88-8cc99774cc64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:49 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-d346e7ea-c2dd-4724-bceb-a74733d8be90 tempest-CreateVolumesFromSnapshotTest-983667542 None] Created volume successfully. Jul 03 14:16:50 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 1G" returned: 0 in 0.779s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:50 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[01988c6b-3b8c-4125-9b3a-05c98d5089b1]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:50 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 Jul 03 14:16:50 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:50 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 1073741824" returned: 0 in 1.000s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:50 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 Jul 03 14:16:50 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:51 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687" returned: 0 in 0.911s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:51 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:51 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 Jul 03 14:16:51 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635" returned: 0 in 0.759s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:51 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:16:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.456s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02d8fcd-c864-4bf0-a398-4c9137832716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac75a4a5-ff06-419a-993a-9d74fad73635', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafa250f-8541-41e2-ae84-009061544df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:51 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] Creating offline snapshot 2611c210-9ada-4a78-9be2-e14c0d7b9224 of volume b6086724-5b4c-4035-b5bf-a6deaca23312 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:16:51 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Volume volume-ac75a4a5-ff06-419a-993a-9d74fad73635 (ac75a4a5-ff06-419a-993a-9d74fad73635): created successfully Jul 03 14:16:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafa250f-8541-41e2-ae84-009061544df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:51 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Flow 'volume_create_manager' (b051395c-d825-4fd9-a1d9-646398f1f5ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:51 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50b0fb3-5c58-4f10-af86-d15dc040a23c]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:51 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f80236ab-8ea3-4911-8fba-f1dff100b474 tempest-VolumeDependencyTests-365414090 None] Created volume successfully. Jul 03 14:16:51 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312 Jul 03 14:16:51 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:52 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687" returned: 1 in 0.858s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:16:52 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Downloaded image 25bbcef6-4e47-4c37-aec0-334ff22b7737 ((None, [{'url': 'file:///opt/stack/data/glance/images/25bbcef6-4e47-4c37-aec0-334ff22b7737', 'metadata': {}}])) to volume 35918ed0-8996-4dad-8351-0de80e091687 successfully. {{(pid=86805) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 14:16:52 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Temporary image 25bbcef6-4e47-4c37-aec0-334ff22b7737 for user 3d50c878d52b4d2fb7320a813559c461 is deleted. {{(pid=86805) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 14:16:52 devstack cinder-volume[86805]: DEBUG cinder.volume.volume_utils [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Marking volume 35918ed0-8996-4dad-8351-0de80e091687 as bootable. {{(pid=86805) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 14:16:52 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Copying metadata from image 25bbcef6-4e47-4c37-aec0-334ff22b7737 to 35918ed0-8996-4dad-8351-0de80e091687. {{(pid=86805) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 14:16:52 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Creating volume glance metadata for volume 35918ed0-8996-4dad-8351-0de80e091687 backed by image 25bbcef6-4e47-4c37-aec0-334ff22b7737 with: {'image_id': '25bbcef6-4e47-4c37-aec0-334ff22b7737', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ee64bb933bc387d3e113752fef2c5251', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86805) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 14:16:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d5cbbd-e517-4f75-8b82-e598d7b50ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35918ed0-8996-4dad-8351-0de80e091687', 'volume_size': 1, 'image_id': '25bbcef6-4e47-4c37-aec0-334ff22b7737', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25bbcef6-4e47-4c37-aec0-334ff22b7737', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ee64bb933bc387d3e113752fef2c5251', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a4573813438c411d98b46d07750c8cff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c2f4d2e6aa21e603eb43348c895189a10c1dfbb92ff7c8f2fb1a82f2cf2861ea6771851d5f940bc2790de8f9fce086c12802cf5373bc235c4c4f8354cfec8fa', 'id': '25bbcef6-4e47-4c37-aec0-334ff22b7737', 'created_at': datetime.datetime(2026, 7, 3, 12, 16, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 16, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25bbcef6-4e47-4c37-aec0-334ff22b7737/file', 'properties': {}}, 'image_service': }' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4d9b85-d2f6-4922-a556-05b0dafafb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:52 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Volume volume-35918ed0-8996-4dad-8351-0de80e091687 (35918ed0-8996-4dad-8351-0de80e091687): created successfully Jul 03 14:16:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4d9b85-d2f6-4922-a556-05b0dafafb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:52 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Flow 'volume_create_manager' (93f842ca-9e35-4b06-8e7b-31ebbfb64d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:52 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-eb806400-de78-472b-8ff1-a0bc4db29c43 tempest-VolumeImageDependencyTests-593320584 None] Created volume successfully. Jul 03 14:16:52 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312" returned: 0 in 0.890s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:52 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224 1G Jul 03 14:16:52 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Acquiring lock "cinder-35918ed0-8996-4dad-8351-0de80e091687-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Lock "cinder-35918ed0-8996-4dad-8351-0de80e091687-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Acquiring lock "cinder-quobyte-35918ed0-8996-4dad-8351-0de80e091687" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Lock "cinder-quobyte-35918ed0-8996-4dad-8351-0de80e091687" acquired by "delete_volume" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:53 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bfce9d-25ad-4c50-80c2-53a042010fd2]: (4, 'raw') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:53 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 Jul 03 14:16:53 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:53 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224 1G" returned: 0 in 1.044s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6086724-5b4c-4035-b5bf-a6deaca23312 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:53 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6086724-5b4c-4035-b5bf-a6deaca23312 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224 Jul 03 14:16:53 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:54 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687" returned: 0 in 0.822s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:54 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 Jul 03 14:16:54 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:54 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6086724-5b4c-4035-b5bf-a6deaca23312 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224" returned: 0 in 0.778s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:54 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224 is being set with open permissions: ugo+rw Jul 03 14:16:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:54 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224 Jul 03 14:16:54 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:54 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687" returned: 1 in 0.833s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687' failed. Not Retrying. {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:16:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:54 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687 Jul 03 14:16:54 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:55 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224" returned: 0 in 0.719s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:55 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.info Jul 03 14:16:55 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:55 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35918ed0-8996-4dad-8351-0de80e091687" returned: 0 in 0.823s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:55 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Lock "cinder-quobyte-35918ed0-8996-4dad-8351-0de80e091687" released by "delete_volume" :: held 2.575s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:55 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Created reservations ['71943978-aa70-4dd1-851b-43cb3aaf77e8', '965cd72e-f35b-4011-b326-75ac0183cfd3', '9b374746-eec2-4448-97bb-499cae8ebe71', 'cd31ca9b-f93f-4114-91aa-13e87c2f2606'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:16:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:55 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:55 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:55 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:16:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.info" returned: 0 in 0.754s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:55 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.info is being set with open permissions: ugo+rw Jul 03 14:16:55 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:55 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.info Jul 03 14:16:55 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:56 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.821s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:56 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:56 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:56 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Deleted volume successfully. Jul 03 14:16:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.info" returned: 0 in 0.813s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.181s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.536s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:56 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] Creating offline snapshot 3db6a0fe-cd62-475d-8079-151b17eb5973 of volume ac75a4a5-ff06-419a-993a-9d74fad73635 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:16:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-42a68646-aff4-4828-b7bb-4f2c994a014b tempest-VolumeImageDependencyTests-593320584 None] Lock "cinder-35918ed0-8996-4dad-8351-0de80e091687-delete_volume" released by "delete_volume" :: held 3.727s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:56 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-d2ef1c59-47ac-4c3c-94d4-7bfb248dc829 tempest-CreateVolumesFromSnapshotTest-983667542 None] Create snapshot completed successfully Jul 03 14:16:56 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e7da66-21ac-4fd4-ac3a-31f606947cce]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:56 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 Jul 03 14:16:56 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:57 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635" returned: 0 in 1.013s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:57 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973 1G Jul 03 14:16:57 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Flow 'volume_create_manager' (91dce864-1414-4c32-999c-0b47255eec73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35604f23-32c9-4941-b117-d1276afe8057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35604f23-32c9-4941-b117-d1276afe8057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2092588844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef6a4c7-4b7e-4b96-812f-b881025757eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f89bde39af4e499456e9e7ff9a6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:58Z,use_quota=True,user_id='9173a23853f642a7bfea37e19a3e63e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff456f0b-a7a4-42a4-b492-522cc985c18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff456f0b-a7a4-42a4-b492-522cc985c18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34117a0c-ee91-456b-a145-4e81942dbb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34117a0c-ee91-456b-a145-4e81942dbb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ef6a4c7-4b7e-4b96-812f-b881025757eb', 'volume_name': 'volume-4ef6a4c7-4b7e-4b96-812f-b881025757eb', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fab46e-7e3d-40e7-bae8-dcdcf8a565ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fab46e-7e3d-40e7-bae8-dcdcf8a565ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c4128df-8a9f-490b-bf6d-7a3d4fddf35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:58 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume 4ef6a4c7-4b7e-4b96-812f-b881025757eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ef6a4c7-4b7e-4b96-812f-b881025757eb', 'volume_size': 1} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:58 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:16:58 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:58 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Flow 'volume_create_manager' (a91ce176-a0f6-436d-94c7-daf21b2459ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01631cd-a4eb-44e7-b8a7-eb38a7af6bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01631cd-a4eb-44e7-b8a7-eb38a7af6bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1046672323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51e7761-a1b6-48ef-b273-119cd0a5ab5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f89bde39af4e499456e9e7ff9a6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:59Z,use_quota=True,user_id='9173a23853f642a7bfea37e19a3e63e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a5805a-99c1-44df-b738-5cc3f060f7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a5805a-99c1-44df-b738-5cc3f060f7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1a5f2f-4d1f-47ec-a71f-29d64882ce19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1a5f2f-4d1f-47ec-a71f-29d64882ce19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f51e7761-a1b6-48ef-b273-119cd0a5ab5b', 'volume_name': 'volume-f51e7761-a1b6-48ef-b273-119cd0a5ab5b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8570fd-4378-4dc3-947a-5c6f9027b1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8570fd-4378-4dc3-947a-5c6f9027b1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0fa968-e898-4c32-9ea1-945676c02077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:59 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume f51e7761-a1b6-48ef-b273-119cd0a5ab5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f51e7761-a1b6-48ef-b273-119cd0a5ab5b', 'volume_size': 1} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:59 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973 1G" returned: 0 in 1.358s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac75a4a5-ff06-419a-993a-9d74fad73635 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:59 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac75a4a5-ff06-419a-993a-9d74fad73635 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973 Jul 03 14:16:59 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:59 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.068s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Flow 'volume_create_manager' (7f21c206-a481-490a-b386-bbc8c82bc969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fc0121-f015-40d1-92b3-48c7bf3b4eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fc0121-f015-40d1-92b3-48c7bf3b4eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1510093367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da13f2d9-f4c8-4177-acbd-6a1991e58012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f89bde39af4e499456e9e7ff9a6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:00Z,use_quota=True,user_id='9173a23853f642a7bfea37e19a3e63e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9704b2-0cc7-4032-9104-c00522dd2510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9704b2-0cc7-4032-9104-c00522dd2510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596be6b8-2e41-4607-979e-ef062a28f215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596be6b8-2e41-4607-979e-ef062a28f215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da13f2d9-f4c8-4177-acbd-6a1991e58012', 'volume_name': 'volume-da13f2d9-f4c8-4177-acbd-6a1991e58012', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cae1644-ac83-4da0-bef6-354a54f6fb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cae1644-ac83-4da0-bef6-354a54f6fb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2644f55-3617-4a79-b793-b926f9dcf180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:16:59 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume da13f2d9-f4c8-4177-acbd-6a1991e58012: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da13f2d9-f4c8-4177-acbd-6a1991e58012', 'volume_size': 1} Jul 03 14:16:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Flow 'volume_create_manager' (34bb01f6-352f-4841-8428-b5b0ec2063c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd5bc45-3fcc-4d07-a011-baa374f16999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:00 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd5bc45-3fcc-4d07-a011-baa374f16999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892422694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0060466-9b03-4a72-aa69-0c039d073641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e1d4776bcf491b8995156ce52530e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:00Z,use_quota=True,user_id='7e781bb0c05e45a2921a15cb08df5c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a8e61e-9075-460c-a556-0e3942011f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a8e61e-9075-460c-a556-0e3942011f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34dd1e9b-a1ae-407a-9d00-1af475ea8fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34dd1e9b-a1ae-407a-9d00-1af475ea8fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0060466-9b03-4a72-aa69-0c039d073641', 'volume_name': 'volume-b0060466-9b03-4a72-aa69-0c039d073641', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7305c8c-08f9-49f7-987e-c3d5aedcbbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7305c8c-08f9-49f7-987e-c3d5aedcbbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d307129e-10b9-4af6-883c-7d70b1869a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:00 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Volume b0060466-9b03-4a72-aa69-0c039d073641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0060466-9b03-4a72-aa69-0c039d073641', 'volume_size': 1} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac75a4a5-ff06-419a-993a-9d74fad73635 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973" returned: 0 in 1.128s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:00 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973 is being set with open permissions: ugo+rw Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:00 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973 Jul 03 14:17:00 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Flow 'volume_create_manager' (914c9ad9-92b7-4f05-9063-dfbba87fcec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb27d16a-e650-4b38-9316-9bdec245b89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb27d16a-e650-4b38-9316-9bdec245b89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1212230101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2709b536-5849-4e73-8f83-fe3efbea3a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f89bde39af4e499456e9e7ff9a6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:00Z,use_quota=True,user_id='9173a23853f642a7bfea37e19a3e63e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4e9aa3-4c10-464b-98ab-0c02dee39878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4e9aa3-4c10-464b-98ab-0c02dee39878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70af91e6-0b05-42c3-ab4f-b52461e88e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70af91e6-0b05-42c3-ab4f-b52461e88e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2709b536-5849-4e73-8f83-fe3efbea3a94', 'volume_name': 'volume-2709b536-5849-4e73-8f83-fe3efbea3a94', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72a0d42-a4cf-4045-b116-92b99d4f5fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72a0d42-a4cf-4045-b116-92b99d4f5fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061a485d-6c09-41fc-b2ca-824d7f9fb7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:00 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume 2709b536-5849-4e73-8f83-fe3efbea3a94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2709b536-5849-4e73-8f83-fe3efbea3a94', 'volume_size': 1} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Flow 'volume_create_manager' (17114c76-90de-4b1f-963e-2407bc7c92e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fa761f-c7b4-4c49-806b-65b01279054c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fa761f-c7b4-4c49-806b-65b01279054c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-314311139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b6eb2a-252c-4ceb-abd2-71732952f24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f89bde39af4e499456e9e7ff9a6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:01Z,use_quota=True,user_id='9173a23853f642a7bfea37e19a3e63e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0384f1-058e-4def-b887-180360eeae63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0384f1-058e-4def-b887-180360eeae63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2392dcf5-9672-4b77-8fbe-ea7b51c18543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2392dcf5-9672-4b77-8fbe-ea7b51c18543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35b6eb2a-252c-4ceb-abd2-71732952f24e', 'volume_name': 'volume-35b6eb2a-252c-4ceb-abd2-71732952f24e', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bea30c-9bc4-4a74-8ef0-db25600fe84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bea30c-9bc4-4a74-8ef0-db25600fe84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083cc24d-f275-414e-b7a0-17aa83ad5412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:00 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume 35b6eb2a-252c-4ceb-abd2-71732952f24e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35b6eb2a-252c-4ceb-abd2-71732952f24e', 'volume_size': 1} Jul 03 14:17:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:01 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973" returned: 0 in 0.782s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:01 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.info Jul 03 14:17:01 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:01 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:17:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Flow 'volume_create_manager' (6af1939b-d181-449b-8b5f-39f6c78d632d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848b9168-189f-468a-954f-300f07f369ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848b9168-189f-468a-954f-300f07f369ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d2b3d9-1085-4ce2-8375-1933c3e4b2e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='495b72ff79c84c73a29468e39e88db71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:01Z,use_quota=True,user_id='061f1eba11ed41e8919087633d3a7b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1ba081-31e2-4b6d-8c9c-60fd15a0f11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1ba081-31e2-4b6d-8c9c-60fd15a0f11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b3de5d-87d2-49f3-a367-b76a78d699ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b3de5d-87d2-49f3-a367-b76a78d699ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43d2b3d9-1085-4ce2-8375-1933c3e4b2e9', 'volume_name': 'volume-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53ceab5-7b34-4104-8507-a366ad03b3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53ceab5-7b34-4104-8507-a366ad03b3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:01 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aacab297-0823-4a68-ae58-8e6549ef97c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:01 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Volume 43d2b3d9-1085-4ce2-8375-1933c3e4b2e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9', 'volume_size': 1} Jul 03 14:17:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:01 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.info" returned: 0 in 0.748s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:01 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.info is being set with open permissions: ugo+rw Jul 03 14:17:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:01 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.info Jul 03 14:17:01 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:02 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.info" returned: 0 in 0.653s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.803s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.092s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2092588844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef6a4c7-4b7e-4b96-812f-b881025757eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f89bde39af4e499456e9e7ff9a6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:58Z,use_quota=True,user_id='9173a23853f642a7bfea37e19a3e63e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:17:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Creating volume 4ef6a4c7-4b7e-4b96-812f-b881025757eb {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:17:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:02 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:17:02 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:17:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ef6a4c7-4b7e-4b96-812f-b881025757eb 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:02 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ef6a4c7-4b7e-4b96-812f-b881025757eb 1073741824 Jul 03 14:17:02 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:02 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b82bd543-f9a1-4f2d-a854-69ffa9136216 tempest-VolumeDependencyTests-365414090 None] Create snapshot completed successfully Jul 03 14:17:03 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:17:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Flow 'volume_create_manager' (011e6603-5007-4db4-af0b-dbbe05da5eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a235ce-fe83-4cf0-8736-63ab17858656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a235ce-fe83-4cf0-8736-63ab17858656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-88356553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b373ad6d5494f1e8fcbe93457b360b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3db6a0fe-cd62-475d-8079-151b17eb5973,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:03Z,use_quota=True,user_id='dab98dc701354a8e910ea948045e6f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dda3a1e-4c82-4998-a4de-136620e616d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dda3a1e-4c82-4998-a4de-136620e616d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839ea783-805c-4dde-9b0d-7872cc8cf095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839ea783-805c-4dde-9b0d-7872cc8cf095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76', 'volume_name': 'volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76', 'volume_size': 1, 'snapshot_id': '3db6a0fe-cd62-475d-8079-151b17eb5973'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee5a0af-964e-4843-b629-72181ecfede7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee5a0af-964e-4843-b629-72181ecfede7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e532fe-9ce3-4e40-bf9d-fe6589039371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:03 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Volume 864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76', 'volume_size': 1, 'snapshot_id': '3db6a0fe-cd62-475d-8079-151b17eb5973'} Jul 03 14:17:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:03 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ef6a4c7-4b7e-4b96-812f-b881025757eb 1073741824" returned: 0 in 1.018s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ef6a4c7-4b7e-4b96-812f-b881025757eb {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:03 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ef6a4c7-4b7e-4b96-812f-b881025757eb Jul 03 14:17:03 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:04 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ef6a4c7-4b7e-4b96-812f-b881025757eb" returned: 0 in 0.635s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:17:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.143s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1046672323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51e7761-a1b6-48ef-b273-119cd0a5ab5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f89bde39af4e499456e9e7ff9a6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:16:59Z,use_quota=True,user_id='9173a23853f642a7bfea37e19a3e63e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:17:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Creating volume f51e7761-a1b6-48ef-b273-119cd0a5ab5b {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:17:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:17:04 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:17:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f51e7761-a1b6-48ef-b273-119cd0a5ab5b 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:04 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f51e7761-a1b6-48ef-b273-119cd0a5ab5b 1073741824 Jul 03 14:17:04 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c4128df-8a9f-490b-bf6d-7a3d4fddf35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ef6a4c7-4b7e-4b96-812f-b881025757eb', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4c38f1-51f2-4184-844e-b90cbb3bab11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:04 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume volume-4ef6a4c7-4b7e-4b96-812f-b881025757eb (4ef6a4c7-4b7e-4b96-812f-b881025757eb): created successfully Jul 03 14:17:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4c38f1-51f2-4184-844e-b90cbb3bab11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Flow 'volume_create_manager' (91dce864-1414-4c32-999c-0b47255eec73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:04 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-85ad983a-e890-439a-bef2-70de600b4da6 tempest-CreateVolumesFromSnapshotTest-983667542 None] Created volume successfully. Jul 03 14:17:05 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f51e7761-a1b6-48ef-b273-119cd0a5ab5b 1073741824" returned: 0 in 0.813s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=138,cinder:UPDATE=179,cinder:DELETE=19,cinder:INSERT=44 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=137,cinder:UPDATE=189,cinder:INSERT=55,cinder:DELETE=16 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f51e7761-a1b6-48ef-b273-119cd0a5ab5b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:05 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f51e7761-a1b6-48ef-b273-119cd0a5ab5b Jul 03 14:17:05 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:05 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f51e7761-a1b6-48ef-b273-119cd0a5ab5b" returned: 0 in 0.611s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.778s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1510093367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da13f2d9-f4c8-4177-acbd-6a1991e58012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f89bde39af4e499456e9e7ff9a6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:00Z,use_quota=True,user_id='9173a23853f642a7bfea37e19a3e63e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Creating volume da13f2d9-f4c8-4177-acbd-6a1991e58012 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:17:05 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-da13f2d9-f4c8-4177-acbd-6a1991e58012 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:05 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-da13f2d9-f4c8-4177-acbd-6a1991e58012 1073741824 Jul 03 14:17:05 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0fa968-e898-4c32-9ea1-945676c02077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f51e7761-a1b6-48ef-b273-119cd0a5ab5b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d0ad4c-95cb-4615-9790-7169dc94eb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:05 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume volume-f51e7761-a1b6-48ef-b273-119cd0a5ab5b (f51e7761-a1b6-48ef-b273-119cd0a5ab5b): created successfully Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d0ad4c-95cb-4615-9790-7169dc94eb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Flow 'volume_create_manager' (a91ce176-a0f6-436d-94c7-daf21b2459ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:05 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-6ef1d890-f3a8-405e-9925-952274dd560d tempest-CreateVolumesFromSnapshotTest-983667542 None] Created volume successfully. Jul 03 14:17:06 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-da13f2d9-f4c8-4177-acbd-6a1991e58012 1073741824" returned: 0 in 0.856s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-da13f2d9-f4c8-4177-acbd-6a1991e58012 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:06 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-da13f2d9-f4c8-4177-acbd-6a1991e58012 Jul 03 14:17:06 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:07 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-da13f2d9-f4c8-4177-acbd-6a1991e58012" returned: 0 in 0.656s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:17:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.989s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892422694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0060466-9b03-4a72-aa69-0c039d073641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e1d4776bcf491b8995156ce52530e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:00Z,use_quota=True,user_id='7e781bb0c05e45a2921a15cb08df5c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:17:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Creating volume b0060466-9b03-4a72-aa69-0c039d073641 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:17:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:17:07 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:17:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b0060466-9b03-4a72-aa69-0c039d073641 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2644f55-3617-4a79-b793-b926f9dcf180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da13f2d9-f4c8-4177-acbd-6a1991e58012', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:07 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b0060466-9b03-4a72-aa69-0c039d073641 1073741824 Jul 03 14:17:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d219af-f6a2-4449-a528-3bd70644a156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:07 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:07 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume volume-da13f2d9-f4c8-4177-acbd-6a1991e58012 (da13f2d9-f4c8-4177-acbd-6a1991e58012): created successfully Jul 03 14:17:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d219af-f6a2-4449-a528-3bd70644a156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Flow 'volume_create_manager' (7f21c206-a481-490a-b386-bbc8c82bc969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:07 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-3b86e561-e41f-4182-8c4d-1df5fa013cdb tempest-CreateVolumesFromSnapshotTest-983667542 None] Created volume successfully. Jul 03 14:17:08 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b0060466-9b03-4a72-aa69-0c039d073641 1073741824" returned: 0 in 0.815s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b0060466-9b03-4a72-aa69-0c039d073641 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:08 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b0060466-9b03-4a72-aa69-0c039d073641 Jul 03 14:17:08 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:08 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b0060466-9b03-4a72-aa69-0c039d073641" returned: 0 in 0.606s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.200s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1212230101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2709b536-5849-4e73-8f83-fe3efbea3a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f89bde39af4e499456e9e7ff9a6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:00Z,use_quota=True,user_id='9173a23853f642a7bfea37e19a3e63e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Creating volume 2709b536-5849-4e73-8f83-fe3efbea3a94 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:17:08 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2709b536-5849-4e73-8f83-fe3efbea3a94 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:08 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2709b536-5849-4e73-8f83-fe3efbea3a94 1073741824 Jul 03 14:17:08 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d307129e-10b9-4af6-883c-7d70b1869a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0060466-9b03-4a72-aa69-0c039d073641', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08610096-c47d-41b6-b8c0-a5d0dc565e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:08 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Volume volume-b0060466-9b03-4a72-aa69-0c039d073641 (b0060466-9b03-4a72-aa69-0c039d073641): created successfully Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08610096-c47d-41b6-b8c0-a5d0dc565e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:08 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Flow 'volume_create_manager' (34bb01f6-352f-4841-8428-b5b0ec2063c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:08 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-af673841-360e-4ec0-8335-f40b401ec3cd tempest-ProjectReaderTests-943659594 None] Created volume successfully. Jul 03 14:17:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] Acquiring lock "cinder-b0060466-9b03-4a72-aa69-0c039d073641-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] Lock "cinder-b0060466-9b03-4a72-aa69-0c039d073641-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] Acquiring lock "cinder-quobyte-b0060466-9b03-4a72-aa69-0c039d073641" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] Lock "cinder-quobyte-b0060466-9b03-4a72-aa69-0c039d073641" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:09 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[95695f17-bd9d-4e13-a1a2-720a63860cbf]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b0060466-9b03-4a72-aa69-0c039d073641 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:09 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b0060466-9b03-4a72-aa69-0c039d073641 Jul 03 14:17:09 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:09 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2709b536-5849-4e73-8f83-fe3efbea3a94 1073741824" returned: 0 in 0.852s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2709b536-5849-4e73-8f83-fe3efbea3a94 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:09 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2709b536-5849-4e73-8f83-fe3efbea3a94 Jul 03 14:17:09 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:09 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b0060466-9b03-4a72-aa69-0c039d073641" returned: 0 in 0.766s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b0060466-9b03-4a72-aa69-0c039d073641 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:10 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b0060466-9b03-4a72-aa69-0c039d073641 Jul 03 14:17:10 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:10 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2709b536-5849-4e73-8f83-fe3efbea3a94" returned: 0 in 0.655s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.570s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-314311139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b6eb2a-252c-4ceb-abd2-71732952f24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f89bde39af4e499456e9e7ff9a6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:01Z,use_quota=True,user_id='9173a23853f642a7bfea37e19a3e63e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Creating volume 35b6eb2a-252c-4ceb-abd2-71732952f24e {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:17:10 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35b6eb2a-252c-4ceb-abd2-71732952f24e 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061a485d-6c09-41fc-b2ca-824d7f9fb7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2709b536-5849-4e73-8f83-fe3efbea3a94', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:10 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35b6eb2a-252c-4ceb-abd2-71732952f24e 1073741824 Jul 03 14:17:10 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39470d1-4441-4d02-8a26-5f98e0200e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:10 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume volume-2709b536-5849-4e73-8f83-fe3efbea3a94 (2709b536-5849-4e73-8f83-fe3efbea3a94): created successfully Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39470d1-4441-4d02-8a26-5f98e0200e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Flow 'volume_create_manager' (914c9ad9-92b7-4f05-9063-dfbba87fcec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:10 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-49946456-d5a5-484d-a518-04a754f97d9d tempest-CreateVolumesFromSnapshotTest-983667542 None] Created volume successfully. Jul 03 14:17:10 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b0060466-9b03-4a72-aa69-0c039d073641" returned: 0 in 0.644s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] Lock "cinder-quobyte-b0060466-9b03-4a72-aa69-0c039d073641" released by "delete_volume" :: held 1.459s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] Created reservations ['43d51b2e-9e69-4edc-a602-bbe426d79fc7', '386d47e4-5fdf-49bf-ab6e-d3af23df0bcb', 'b2bc51ee-cf0d-4d81-8184-88f3f2c37fae', '0169568f-bec1-40a6-8dae-d24ca7cc19f5'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:10 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:17:10 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:11 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35b6eb2a-252c-4ceb-abd2-71732952f24e 1073741824" returned: 0 in 0.868s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35b6eb2a-252c-4ceb-abd2-71732952f24e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:11 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35b6eb2a-252c-4ceb-abd2-71732952f24e Jul 03 14:17:11 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:11 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.723s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:17:11 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] Deleted volume successfully. Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5e0a9daa-a995-4c9a-a8f0-e0e92324c80d tempest-ProjectReaderTests-943659594 None] Lock "cinder-b0060466-9b03-4a72-aa69-0c039d073641-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Flow 'volume_create_manager' (6d6e674f-6d09-4a1c-bf87-15407948a945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38ef5dc-ccfc-4848-9387-5aae3df96ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38ef5dc-ccfc-4848-9387-5aae3df96ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1999657425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d195ccb-e178-49d3-9fc8-41694b745a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e1d4776bcf491b8995156ce52530e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:12Z,use_quota=True,user_id='7e781bb0c05e45a2921a15cb08df5c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15992e3-2878-4087-a036-5f5b269f7357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15992e3-2878-4087-a036-5f5b269f7357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c5e108-8f45-41f6-826e-35c6cd84cf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c5e108-8f45-41f6-826e-35c6cd84cf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d195ccb-e178-49d3-9fc8-41694b745a45', 'volume_name': 'volume-7d195ccb-e178-49d3-9fc8-41694b745a45', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687c7263-61cf-477d-ad22-c1f081b77111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687c7263-61cf-477d-ad22-c1f081b77111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aefd4f9-c3ca-45c9-8bbc-0180b03e8129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:11 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Volume 7d195ccb-e178-49d3-9fc8-41694b745a45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d195ccb-e178-49d3-9fc8-41694b745a45', 'volume_size': 1} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:11 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35b6eb2a-252c-4ceb-abd2-71732952f24e" returned: 0 in 0.738s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.652s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d2b3d9-1085-4ce2-8375-1933c3e4b2e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='495b72ff79c84c73a29468e39e88db71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:01Z,use_quota=True,user_id='061f1eba11ed41e8919087633d3a7b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Creating volume 43d2b3d9-1085-4ce2-8375-1933c3e4b2e9 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:17:11 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:17:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083cc24d-f275-414e-b7a0-17aa83ad5412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35b6eb2a-252c-4ceb-abd2-71732952f24e', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:12 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9 1073741824 Jul 03 14:17:12 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e87cb8-4dd2-40d9-9975-1ac092a93c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:12 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Volume volume-35b6eb2a-252c-4ceb-abd2-71732952f24e (35b6eb2a-252c-4ceb-abd2-71732952f24e): created successfully Jul 03 14:17:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e87cb8-4dd2-40d9-9975-1ac092a93c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Flow 'volume_create_manager' (17114c76-90de-4b1f-963e-2407bc7c92e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:12 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-8ccd39cf-332c-416e-8bdf-861788d0f7e8 tempest-CreateVolumesFromSnapshotTest-983667542 None] Created volume successfully. Jul 03 14:17:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "cinder-35b6eb2a-252c-4ceb-abd2-71732952f24e-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-35b6eb2a-252c-4ceb-abd2-71732952f24e-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "cinder-quobyte-35b6eb2a-252c-4ceb-abd2-71732952f24e" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-quobyte-35b6eb2a-252c-4ceb-abd2-71732952f24e" acquired by "delete_volume" :: waited 0.013s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:12 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db4b537-26ac-4ef1-b989-06f977c72ca8]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35b6eb2a-252c-4ceb-abd2-71732952f24e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:12 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35b6eb2a-252c-4ceb-abd2-71732952f24e Jul 03 14:17:12 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:12 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9 1073741824" returned: 0 in 0.906s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:12 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9 Jul 03 14:17:12 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:13 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35b6eb2a-252c-4ceb-abd2-71732952f24e" returned: 0 in 0.862s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35b6eb2a-252c-4ceb-abd2-71732952f24e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:13 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35b6eb2a-252c-4ceb-abd2-71732952f24e Jul 03 14:17:13 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:13 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9" returned: 0 in 0.693s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.084s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Acquiring lock "cinder-quobyte-3db6a0fe-cd62-475d-8079-151b17eb5973-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76" by "_create_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aacab297-0823-4a68-ae58-8e6549ef97c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707efe17-faa5-4cbd-ab8b-549d70a44b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Lock "cinder-quobyte-3db6a0fe-cd62-475d-8079-151b17eb5973-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Creating volume 864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76 from snapshot 3db6a0fe-cd62-475d-8079-151b17eb5973 {{(pid=86805) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Acquiring lock "cinder-quobyte-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76" by "_copy_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Lock "cinder-quobyte-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] snapshot: 3db6a0fe-cd62-475d-8079-151b17eb5973, volume: 864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76, {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 14:17:13 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Volume volume-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9 (43d2b3d9-1085-4ce2-8375-1933c3e4b2e9): created successfully Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707efe17-faa5-4cbd-ab8b-549d70a44b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Flow 'volume_create_manager' (6af1939b-d181-449b-8b5f-39f6c78d632d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d09dc5f-e79d-4b3f-af0f-182ad456983b]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:13 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e4f0b7d8-d69c-4313-b456-6e287a26048b tempest-CinderUnicodeTest-1882744731 None] Created volume successfully. Jul 03 14:17:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:13 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973 Jul 03 14:17:13 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:14 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-35b6eb2a-252c-4ceb-abd2-71732952f24e" returned: 0 in 0.725s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-quobyte-35b6eb2a-252c-4ceb-abd2-71732952f24e" released by "delete_volume" :: held 1.637s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] Created reservations ['f52d690a-3baf-4071-8436-58b7ad444c65', '9a197daa-999d-4fd8-ac91-440404c70d1c', 'aed50ce4-eb83-491f-aa6f-d1ad56bd2e52', '68f9633b-a0eb-472b-9056-b0348ec3ad30'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:14 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:17:14 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:17:14 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Flow 'volume_create_manager' (d4329672-e075-4cb5-96bb-93f7e47ecd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10b1d1e-4c3b-471a-b4c2-7825bb772209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973" returned: 0 in 0.837s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac75a4a5-ff06-419a-993a-9d74fad73635(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] will copy from snapshot at /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Creating direct copy from snapshot {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10b1d1e-4c3b-471a-b4c2-7825bb772209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1947627241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1cbe814-7511-465c-bfd2-5d0919283602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='495b72ff79c84c73a29468e39e88db71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:15Z,use_quota=True,user_id='061f1eba11ed41e8919087633d3a7b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a001a8-ec5e-4ada-8096-c344214e42ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a001a8-ec5e-4ada-8096-c344214e42ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40dc4cc9-aa98-418d-889d-54b9816d2d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40dc4cc9-aa98-418d-889d-54b9816d2d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1cbe814-7511-465c-bfd2-5d0919283602', 'volume_name': 'volume-e1cbe814-7511-465c-bfd2-5d0919283602', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31170e42-c1d2-4f9c-a0d7-98104ecf3ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31170e42-c1d2-4f9c-a0d7-98104ecf3ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a7be26-1ea8-4559-a9b3-a80c557fae30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:14 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Volume e1cbe814-7511-465c-bfd2-5d0919283602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1cbe814-7511-465c-bfd2-5d0919283602', 'volume_size': 1} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[962d223e-8df2-4d23-b7ec-2e608e64828d]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "cinder-2709b536-5849-4e73-8f83-fe3efbea3a94-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-2709b536-5849-4e73-8f83-fe3efbea3a94-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:14 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 Jul 03 14:17:14 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "cinder-quobyte-2709b536-5849-4e73-8f83-fe3efbea3a94" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-quobyte-2709b536-5849-4e73-8f83-fe3efbea3a94" acquired by "delete_volume" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d05b528-b9c3-4ce4-954c-0576aad9e2cc]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2709b536-5849-4e73-8f83-fe3efbea3a94 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:15 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2709b536-5849-4e73-8f83-fe3efbea3a94 Jul 03 14:17:15 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:15 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.678s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:15 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:17:15 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] Deleted volume successfully. Jul 03 14:17:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-c3b6a690-f142-43c3-9848-149c8852962e tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-35b6eb2a-252c-4ceb-abd2-71732952f24e-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:15 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635" returned: 0 in 0.820s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:15 devstack cinder-volume[86805]: DEBUG cinder.utils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Path /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76 not found in is_blk_device check {{(pid=86805) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 14:17:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:15 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76 Jul 03 14:17:15 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:15 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2709b536-5849-4e73-8f83-fe3efbea3a94" returned: 0 in 0.754s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2709b536-5849-4e73-8f83-fe3efbea3a94 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:15 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2709b536-5849-4e73-8f83-fe3efbea3a94 Jul 03 14:17:15 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:16 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2709b536-5849-4e73-8f83-fe3efbea3a94" returned: 0 in 0.698s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-quobyte-2709b536-5849-4e73-8f83-fe3efbea3a94" released by "delete_volume" :: held 1.524s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:16 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] Created reservations ['7dc64aa7-996e-438a-aced-4e639807bb37', '3292da9e-6dc1-4fb9-aefa-8da6b57473c3', '69033db3-84da-4c09-a2e9-2744ba9b78ac', '1ce6e0db-9070-42e0-aea5-533df1cb024a'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:16 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:17:16 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "cinder-da13f2d9-f4c8-4177-acbd-6a1991e58012-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-da13f2d9-f4c8-4177-acbd-6a1991e58012-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "cinder-quobyte-da13f2d9-f4c8-4177-acbd-6a1991e58012" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:17 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-quobyte-da13f2d9-f4c8-4177-acbd-6a1991e58012" acquired by "delete_volume" :: waited 0.032s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:17 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3387fa6b-b45d-4b0a-bd0b-3bfc1e59df9e]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-da13f2d9-f4c8-4177-acbd-6a1991e58012 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:17 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-da13f2d9-f4c8-4177-acbd-6a1991e58012 Jul 03 14:17:17 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:18 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.354s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:18 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:17:18 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] Deleted volume successfully. Jul 03 14:17:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e6fa8cda-7542-4d70-9ec5-3a301de23b78 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-2709b536-5849-4e73-8f83-fe3efbea3a94-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:19 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-da13f2d9-f4c8-4177-acbd-6a1991e58012" returned: 0 in 2.113s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-da13f2d9-f4c8-4177-acbd-6a1991e58012 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:19 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-da13f2d9-f4c8-4177-acbd-6a1991e58012 Jul 03 14:17:19 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:20 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76" returned: 0 in 5.213s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:20 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ecfa9e-233a-4214-9531-34066ad1e4ec]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:20 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-da13f2d9-f4c8-4177-acbd-6a1991e58012" returned: 0 in 1.130s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:20 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 Jul 03 14:17:20 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:20 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-quobyte-da13f2d9-f4c8-4177-acbd-6a1991e58012" released by "delete_volume" :: held 3.349s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:20 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] Created reservations ['1731d8c2-62ce-4244-a4a2-22556649547a', '27002be5-39f4-45f9-86e4-2e9b495a2827', '12f31889-5b73-459e-bae7-83aa6430026e', '747a8398-11b7-4a8c-9fe0-0d5a343953e6'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:21 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:17:21 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:21 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.616s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:21 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:17:21 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] Deleted volume successfully. Jul 03 14:17:21 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635" returned: 0 in 0.922s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:21 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Image conversion details: src /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76 {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:17:21 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Converted 1024.00 MB image at 196.37 MB/s Jul 03 14:17:21 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76 is being set with open permissions: ugo+rw Jul 03 14:17:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-56902149-3504-414b-8f19-654dbcba9317 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-da13f2d9-f4c8-4177-acbd-6a1991e58012-delete_volume" released by "delete_volume" :: held 4.289s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:21 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76 Jul 03 14:17:21 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:21 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "cinder-f51e7761-a1b6-48ef-b273-119cd0a5ab5b-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-f51e7761-a1b6-48ef-b273-119cd0a5ab5b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "cinder-quobyte-f51e7761-a1b6-48ef-b273-119cd0a5ab5b" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-quobyte-f51e7761-a1b6-48ef-b273-119cd0a5ab5b" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55a7859-363b-452e-9560-1815966de55d]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f51e7761-a1b6-48ef-b273-119cd0a5ab5b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:22 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f51e7761-a1b6-48ef-b273-119cd0a5ab5b Jul 03 14:17:22 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:22 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76" returned: 0 in 0.623s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Lock "cinder-quobyte-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76" released by "_copy_volume_from_snapshot" :: held 8.585s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Lock "cinder-quobyte-3db6a0fe-cd62-475d-8079-151b17eb5973-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76" released by "_create_volume_from_snapshot" :: held 8.621s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.659s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.398s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1999657425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d195ccb-e178-49d3-9fc8-41694b745a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e1d4776bcf491b8995156ce52530e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:12Z,use_quota=True,user_id='7e781bb0c05e45a2921a15cb08df5c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Creating volume 7d195ccb-e178-49d3-9fc8-41694b745a45 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:17:22 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d195ccb-e178-49d3-9fc8-41694b745a45 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:22 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d195ccb-e178-49d3-9fc8-41694b745a45 1073741824 Jul 03 14:17:22 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e532fe-9ce3-4e40-bf9d-fe6589039371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76', 'volume_size': 1, 'snapshot_id': '3db6a0fe-cd62-475d-8079-151b17eb5973'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cce28f4-3d40-4c6d-bdea-b49739664edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:22 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Volume volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76 (864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76): created successfully Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cce28f4-3d40-4c6d-bdea-b49739664edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Flow 'volume_create_manager' (011e6603-5007-4db4-af0b-dbbe05da5eaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:22 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-62de956c-1d99-4494-92eb-391240d0fa3d tempest-VolumeDependencyTests-365414090 None] Created volume successfully. Jul 03 14:17:22 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f51e7761-a1b6-48ef-b273-119cd0a5ab5b" returned: 0 in 0.733s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f51e7761-a1b6-48ef-b273-119cd0a5ab5b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:22 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f51e7761-a1b6-48ef-b273-119cd0a5ab5b Jul 03 14:17:22 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] Acquiring lock "cinder-3db6a0fe-cd62-475d-8079-151b17eb5973-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] Lock "cinder-3db6a0fe-cd62-475d-8079-151b17eb5973-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] Acquiring lock "cinder-quobyte-ac75a4a5-ff06-419a-993a-9d74fad73635" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] Lock "cinder-quobyte-ac75a4a5-ff06-419a-993a-9d74fad73635" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] Acquiring lock "cinder-quobyte-3db6a0fe-cd62-475d-8079-151b17eb5973" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] Lock "cinder-quobyte-3db6a0fe-cd62-475d-8079-151b17eb5973" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] Deleting offline snapshot 3db6a0fe-cd62-475d-8079-151b17eb5973 of volume ac75a4a5-ff06-419a-993a-9d74fad73635 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] snapshot_file for this snap is: volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[31159845-6a08-4801-96a3-29316a330b1f]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:23 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d195ccb-e178-49d3-9fc8-41694b745a45 1073741824" returned: 0 in 0.854s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d195ccb-e178-49d3-9fc8-41694b745a45 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:23 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d195ccb-e178-49d3-9fc8-41694b745a45 Jul 03 14:17:23 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:23 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973 Jul 03 14:17:23 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:23 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-f51e7761-a1b6-48ef-b273-119cd0a5ab5b" returned: 0 in 0.751s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-quobyte-f51e7761-a1b6-48ef-b273-119cd0a5ab5b" released by "delete_volume" :: held 1.521s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] Created reservations ['65e25588-a510-45d5-b4a0-e3979d1f3656', '9bc2e996-d6fe-4b80-8a0a-a67fc8ff042b', 'cf12de7c-b628-4b1a-886e-3444ba2471c4', 'd48a16e6-e53b-4b94-82c1-1b77649edacd'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:23 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:17:23 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:23 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d195ccb-e178-49d3-9fc8-41694b745a45" returned: 0 in 0.660s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.195s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1947627241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1cbe814-7511-465c-bfd2-5d0919283602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='495b72ff79c84c73a29468e39e88db71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:15Z,use_quota=True,user_id='061f1eba11ed41e8919087633d3a7b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Creating volume e1cbe814-7511-465c-bfd2-5d0919283602 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:17:23 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:23 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602 1073741824 Jul 03 14:17:23 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aefd4f9-c3ca-45c9-8bbc-0180b03e8129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d195ccb-e178-49d3-9fc8-41694b745a45', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff588730-ed3f-4698-a1e1-12839a8b1d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:23 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Volume volume-7d195ccb-e178-49d3-9fc8-41694b745a45 (7d195ccb-e178-49d3-9fc8-41694b745a45): created successfully Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff588730-ed3f-4698-a1e1-12839a8b1d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Flow 'volume_create_manager' (6d6e674f-6d09-4a1c-bf87-15407948a945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:23 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-12d45f96-1b4c-45c4-a395-745d36e9df66 tempest-ProjectReaderTests-943659594 None] Created volume successfully. Jul 03 14:17:23 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973" returned: 0 in 0.843s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac75a4a5-ff06-419a-993a-9d74fad73635(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:17:24 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e85a7e7-9cdd-404e-8bfb-90ed2cfca81d]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:24 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 Jul 03 14:17:24 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "cinder-4ef6a4c7-4b7e-4b96-812f-b881025757eb-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-4ef6a4c7-4b7e-4b96-812f-b881025757eb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "cinder-quobyte-4ef6a4c7-4b7e-4b96-812f-b881025757eb" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-quobyte-4ef6a4c7-4b7e-4b96-812f-b881025757eb" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:24 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[713caff3-1509-4626-a30b-433fa540b1ba]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ef6a4c7-4b7e-4b96-812f-b881025757eb {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:24 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.731s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:24 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:17:24 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] Deleted volume successfully. Jul 03 14:17:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9f0d72ad-9eba-4bea-8261-0c377f49265c tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-f51e7761-a1b6-48ef-b273-119cd0a5ab5b-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:24 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ef6a4c7-4b7e-4b96-812f-b881025757eb Jul 03 14:17:24 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:24 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602 1073741824" returned: 0 in 0.921s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:24 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602 Jul 03 14:17:24 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:24 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635" returned: 0 in 0.910s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:24 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973 Jul 03 14:17:24 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] Acquiring lock "cinder-7d195ccb-e178-49d3-9fc8-41694b745a45-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] Lock "cinder-7d195ccb-e178-49d3-9fc8-41694b745a45-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] Acquiring lock "cinder-quobyte-7d195ccb-e178-49d3-9fc8-41694b745a45" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] Lock "cinder-quobyte-7d195ccb-e178-49d3-9fc8-41694b745a45" acquired by "delete_volume" :: waited 0.033s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:25 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d890f89-f9e1-4414-8d87-64d31ac3e998]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d195ccb-e178-49d3-9fc8-41694b745a45 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:25 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d195ccb-e178-49d3-9fc8-41694b745a45 Jul 03 14:17:25 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:25 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ef6a4c7-4b7e-4b96-812f-b881025757eb" returned: 0 in 0.957s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ef6a4c7-4b7e-4b96-812f-b881025757eb {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:25 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ef6a4c7-4b7e-4b96-812f-b881025757eb Jul 03 14:17:25 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:25 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602" returned: 0 in 0.928s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:17:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a7be26-1ea8-4559-a9b3-a80c557fae30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1cbe814-7511-465c-bfd2-5d0919283602', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963f0393-b8df-495a-a2f5-639fdba893e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:25 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Volume volume-e1cbe814-7511-465c-bfd2-5d0919283602 (e1cbe814-7511-465c-bfd2-5d0919283602): created successfully Jul 03 14:17:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963f0393-b8df-495a-a2f5-639fdba893e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:25 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Flow 'volume_create_manager' (d4329672-e075-4cb5-96bb-93f7e47ecd6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973" returned: 0 in 0.904s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:25 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-40c13a15-3720-4304-aa62-f0f0ddb09df7 tempest-CinderUnicodeTest-1882744731 None] Created volume successfully. Jul 03 14:17:25 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973 Jul 03 14:17:25 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:26 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-4ef6a4c7-4b7e-4b96-812f-b881025757eb" returned: 0 in 0.700s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-quobyte-4ef6a4c7-4b7e-4b96-812f-b881025757eb" released by "delete_volume" :: held 1.718s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:26 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d195ccb-e178-49d3-9fc8-41694b745a45" returned: 0 in 0.925s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d195ccb-e178-49d3-9fc8-41694b745a45 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] Created reservations ['e7f50bb2-59ea-43a7-bfef-ad2a59691e7a', '9d22064e-c5bb-4a4a-bf15-baa52e5fe3a6', 'df13858d-b3e6-4322-8ee2-3184b121ad8d', '7fb7df87-10b0-4b56-b57e-aa9ed8ba3fa1'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:26 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d195ccb-e178-49d3-9fc8-41694b745a45 Jul 03 14:17:26 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:26 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:17:26 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:26 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635.3db6a0fe-cd62-475d-8079-151b17eb5973" returned: 0 in 0.697s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "cinder-2611c210-9ada-4a78-9be2-e14c0d7b9224-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-2611c210-9ada-4a78-9be2-e14c0d7b9224-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "cinder-quobyte-b6086724-5b4c-4035-b5bf-a6deaca23312" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] Lock "cinder-quobyte-3db6a0fe-cd62-475d-8079-151b17eb5973" released by "_delete_snapshot" :: held 3.514s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] Lock "cinder-quobyte-ac75a4a5-ff06-419a-993a-9d74fad73635" released by "delete_snapshot" :: held 3.562s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-quobyte-b6086724-5b4c-4035-b5bf-a6deaca23312" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "cinder-quobyte-2611c210-9ada-4a78-9be2-e14c0d7b9224" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-quobyte-2611c210-9ada-4a78-9be2-e14c0d7b9224" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] Deleting offline snapshot 2611c210-9ada-4a78-9be2-e14c0d7b9224 of volume b6086724-5b4c-4035-b5bf-a6deaca23312 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] snapshot_file for this snap is: volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6ddff3-59c6-47ba-8bfa-a08f5a0bab14]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] Created reservations ['dc2d853f-5a83-46d7-b3ea-fcb445a7acfa', '62c5381a-222d-47dd-bde5-8deef8fe8a82', '8036e4ec-232a-41dc-a219-abd5e47d4f92', '424f60a3-e6b9-4bc7-be28-61f51e379485'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:26 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-7d195ccb-e178-49d3-9fc8-41694b745a45" returned: 0 in 0.746s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:26 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] Delete snapshot completed successfully. Jul 03 14:17:26 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224 Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] Lock "cinder-quobyte-7d195ccb-e178-49d3-9fc8-41694b745a45" released by "delete_volume" :: held 1.741s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:26 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-df5a41ae-8c27-43ad-b6c8-702dece07609 tempest-VolumeDependencyTests-365414090 None] Lock "cinder-3db6a0fe-cd62-475d-8079-151b17eb5973-delete_snapshot" released by "delete_snapshot" :: held 3.843s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:26 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] Created reservations ['56cb4673-2c5a-48b3-b6c6-a9ba480b7258', 'f3d032ee-7fff-4072-b7d5-1d2b8f1a68f4', 'b2357edb-09d5-4f6f-a88b-11af5616bc62', '3c79beff-11a4-4f1f-9386-a94decec76f3'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:27 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.802s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:17:27 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] Deleted volume successfully. Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-552f9653-a173-4367-94ec-55919853cf9e tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-4ef6a4c7-4b7e-4b96-812f-b881025757eb-delete_volume" released by "delete_volume" :: held 2.813s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:27 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:17:27 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] Creating offline snapshot 23f55f5b-9726-4aa5-bd5a-4160bfd6f748 of volume e1cbe814-7511-465c-bfd2-5d0919283602 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[26693261-9708-42cd-86a7-489c00e205d5]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:27 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602 Jul 03 14:17:27 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] Acquiring lock "cinder-ac75a4a5-ff06-419a-993a-9d74fad73635-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] Lock "cinder-ac75a4a5-ff06-419a-993a-9d74fad73635-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] Acquiring lock "cinder-quobyte-ac75a4a5-ff06-419a-993a-9d74fad73635" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] Lock "cinder-quobyte-ac75a4a5-ff06-419a-993a-9d74fad73635" acquired by "delete_volume" :: waited 0.029s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1225e2c-ce65-4b50-82ab-fd928e09b783]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:27 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224" returned: 0 in 0.997s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6086724-5b4c-4035-b5bf-a6deaca23312(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:17:27 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 Jul 03 14:17:27 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b260229-47c6-4f16-b9e1-019ff1584158]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Flow 'volume_create_manager' (f66f5759-18ed-4de9-ada1-93ac9aae6ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d6dd89-428a-4a7e-86ef-e6686f875d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:27 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312 Jul 03 14:17:27 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d6dd89-428a-4a7e-86ef-e6686f875d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873146189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d6b587-5504-40be-8266-24e84cce9a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e1d4776bcf491b8995156ce52530e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:28Z,use_quota=True,user_id='7e781bb0c05e45a2921a15cb08df5c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (681bb913-3bd4-4be8-9521-2128ee8e3791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (681bb913-3bd4-4be8-9521-2128ee8e3791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330a10d9-aa73-424c-9db5-2a59300df27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330a10d9-aa73-424c-9db5-2a59300df27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0d6b587-5504-40be-8266-24e84cce9a49', 'volume_name': 'volume-d0d6b587-5504-40be-8266-24e84cce9a49', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd3b769-22c3-41fa-9498-1730f756e771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd3b769-22c3-41fa-9498-1730f756e771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312bf891-de42-4ff5-92da-0b5347f71c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:28 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Volume d0d6b587-5504-40be-8266-24e84cce9a49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0d6b587-5504-40be-8266-24e84cce9a49', 'volume_size': 1} Jul 03 14:17:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:28 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.060s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:28 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:17:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] Deleted volume successfully. Jul 03 14:17:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4c225d0a-c8c0-4464-995e-82294391a23a tempest-ProjectReaderTests-943659594 None] Lock "cinder-7d195ccb-e178-49d3-9fc8-41694b745a45-delete_volume" released by "delete_volume" :: held 3.152s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:28 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602" returned: 0 in 1.096s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:28 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748 1G Jul 03 14:17:28 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:28 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635" returned: 0 in 1.011s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:28 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635 Jul 03 14:17:28 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:28 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312" returned: 0 in 0.916s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:28 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224 Jul 03 14:17:28 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:29 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748 1G" returned: 0 in 0.794s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1cbe814-7511-465c-bfd2-5d0919283602 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:29 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1cbe814-7511-465c-bfd2-5d0919283602 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748 Jul 03 14:17:29 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:29 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac75a4a5-ff06-419a-993a-9d74fad73635" returned: 0 in 0.641s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] Lock "cinder-quobyte-ac75a4a5-ff06-419a-993a-9d74fad73635" released by "delete_volume" :: held 1.732s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] Created reservations ['79519134-dd51-4bcf-913c-1cc77d295164', '05073331-5b92-4ea1-814b-150a0d182d37', '897076ae-31af-487b-bf6e-17747b4d4268', 'e3db1bfb-c9fa-4543-bd3e-e2642052672c'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:29 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:17:29 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:29 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224" returned: 0 in 0.812s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:29 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224 Jul 03 14:17:29 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] Acquiring lock "cinder-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] Lock "cinder-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] Acquiring lock "cinder-quobyte-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] Lock "cinder-quobyte-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76" acquired by "delete_volume" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:29 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1cbe814-7511-465c-bfd2-5d0919283602 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748" returned: 0 in 0.795s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:29 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748 is being set with open permissions: ugo+rw Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c6a733-7b68-476e-8c56-8bf09c39cf0c]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:29 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748 Jul 03 14:17:29 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:29 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76 Jul 03 14:17:29 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:30 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.728s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:30 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:17:30 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] Deleted volume successfully. Jul 03 14:17:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-97dedd8c-93e9-46f2-9ccf-e04957dd4d83 tempest-VolumeDependencyTests-365414090 None] Lock "cinder-ac75a4a5-ff06-419a-993a-9d74fad73635-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:30 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312.2611c210-9ada-4a78-9be2-e14c0d7b9224" returned: 0 in 0.786s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-quobyte-2611c210-9ada-4a78-9be2-e14c0d7b9224" released by "_delete_snapshot" :: held 3.672s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-quobyte-b6086724-5b4c-4035-b5bf-a6deaca23312" released by "delete_snapshot" :: held 3.713s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:30 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] Created reservations ['1ff1e8f1-0201-49eb-a036-f624c8a455a2', '329d99c6-1fc2-4903-9360-ba58c7900d73', 'ef4799c7-ebd9-42fb-8831-024e7f3a0751', 'f793a101-1422-40ab-84ed-653611956c46'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:30 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] Delete snapshot completed successfully. Jul 03 14:17:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-83b171a7-7ce0-43e6-955f-0233ed6b5b84 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-2611c210-9ada-4a78-9be2-e14c0d7b9224-delete_snapshot" released by "delete_snapshot" :: held 3.907s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:30 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748" returned: 0 in 0.730s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:30 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.info Jul 03 14:17:30 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:30 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76" returned: 0 in 0.810s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:30 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76 Jul 03 14:17:30 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "cinder-b6086724-5b4c-4035-b5bf-a6deaca23312-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-b6086724-5b4c-4035-b5bf-a6deaca23312-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "cinder-quobyte-b6086724-5b4c-4035-b5bf-a6deaca23312" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-quobyte-b6086724-5b4c-4035-b5bf-a6deaca23312" acquired by "delete_volume" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:31 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0ed6cb-a2b8-46f6-90f8-416042a0b735]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:31 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312 Jul 03 14:17:31 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:31 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.info" returned: 0 in 0.690s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:31 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.info is being set with open permissions: ugo+rw Jul 03 14:17:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:31 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.info Jul 03 14:17:31 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:31 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76" returned: 0 in 0.818s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] Lock "cinder-quobyte-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76" released by "delete_volume" :: held 1.700s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:31 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] Created reservations ['23572ffd-4bb9-495d-a5aa-92bb6aaefab4', 'e53333c6-12c3-4078-b04d-51f2a8665afd', '24246925-764d-415e-8fb2-b626ad2bc016', '4f00fe60-6bf6-4cde-900b-dce37ce3dcd7'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:31 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:17:31 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:31 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312" returned: 0 in 0.911s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:31 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312 Jul 03 14:17:31 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:32 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.info" returned: 0 in 0.728s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.950s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.028s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873146189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d6b587-5504-40be-8266-24e84cce9a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e1d4776bcf491b8995156ce52530e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:28Z,use_quota=True,user_id='7e781bb0c05e45a2921a15cb08df5c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Creating volume d0d6b587-5504-40be-8266-24e84cce9a49 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:17:32 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d0d6b587-5504-40be-8266-24e84cce9a49 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:32 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d0d6b587-5504-40be-8266-24e84cce9a49 1073741824 Jul 03 14:17:32 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:32 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-1168ca3c-62ba-4ae7-87ae-d2e2925bb338 tempest-CinderUnicodeTest-1882744731 None] Create snapshot completed successfully Jul 03 14:17:32 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.776s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:17:32 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] Deleted volume successfully. Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a2afab27-c3f5-4927-8f31-ef4a4cd9de67 tempest-VolumeDependencyTests-365414090 None] Lock "cinder-864f50e5-e3d8-42bf-adfb-bcc8d1d8ef76-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] Acquiring lock "cinder-23f55f5b-9726-4aa5-bd5a-4160bfd6f748-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] Lock "cinder-23f55f5b-9726-4aa5-bd5a-4160bfd6f748-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] Acquiring lock "cinder-quobyte-e1cbe814-7511-465c-bfd2-5d0919283602" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] Lock "cinder-quobyte-e1cbe814-7511-465c-bfd2-5d0919283602" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] Acquiring lock "cinder-quobyte-23f55f5b-9726-4aa5-bd5a-4160bfd6f748" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] Lock "cinder-quobyte-23f55f5b-9726-4aa5-bd5a-4160bfd6f748" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] Deleting offline snapshot 23f55f5b-9726-4aa5-bd5a-4160bfd6f748 of volume e1cbe814-7511-465c-bfd2-5d0919283602 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] snapshot_file for this snap is: volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec18114-d0e6-48ad-bf82-fbae1a150235]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:32 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748 Jul 03 14:17:32 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:32 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-b6086724-5b4c-4035-b5bf-a6deaca23312" returned: 0 in 0.792s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-quobyte-b6086724-5b4c-4035-b5bf-a6deaca23312" released by "delete_volume" :: held 1.767s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] Created reservations ['136caf2b-986d-4449-a734-2fd0156cc373', '3b4da876-a29f-461d-800f-2a7c1e2accdf', 'bf5c01c6-9c0e-4dee-aa98-e3a6cc743d95', '2ac61e65-2ac5-46d8-9eef-0361ae4701d6'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:32 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:17:32 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:33 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d0d6b587-5504-40be-8266-24e84cce9a49 1073741824" returned: 0 in 1.143s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d0d6b587-5504-40be-8266-24e84cce9a49 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:33 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d0d6b587-5504-40be-8266-24e84cce9a49 Jul 03 14:17:33 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:33 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748" returned: 0 in 1.108s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1cbe814-7511-465c-bfd2-5d0919283602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:17:33 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2877a489-9fea-4081-b7dd-6c500d9595b6]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:33 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602 Jul 03 14:17:33 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:34 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d0d6b587-5504-40be-8266-24e84cce9a49" returned: 0 in 0.934s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] <== create_volume: return (2161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:17:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312bf891-de42-4ff5-92da-0b5347f71c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0d6b587-5504-40be-8266-24e84cce9a49', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:34 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a9cc3f-147b-46a8-be0e-3bba5724fd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 1.399s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:34 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:17:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] Deleted volume successfully. Jul 03 14:17:34 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Volume volume-d0d6b587-5504-40be-8266-24e84cce9a49 (d0d6b587-5504-40be-8266-24e84cce9a49): created successfully Jul 03 14:17:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a9cc3f-147b-46a8-be0e-3bba5724fd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Flow 'volume_create_manager' (f66f5759-18ed-4de9-ada1-93ac9aae6ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-496571db-ce94-4b48-9234-8c8b2b422121 tempest-ProjectReaderTests-943659594 None] Created volume successfully. Jul 03 14:17:34 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f9f0e5be-51d1-4d34-b37f-d6ffe7c9cd47 tempest-CreateVolumesFromSnapshotTest-983667542 None] Lock "cinder-b6086724-5b4c-4035-b5bf-a6deaca23312-delete_volume" released by "delete_volume" :: held 3.495s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:34 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602" returned: 0 in 1.060s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:34 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748 Jul 03 14:17:34 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] Acquiring lock "cinder-d0d6b587-5504-40be-8266-24e84cce9a49-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] Lock "cinder-d0d6b587-5504-40be-8266-24e84cce9a49-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:35 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] Acquiring lock "cinder-quobyte-d0d6b587-5504-40be-8266-24e84cce9a49" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748" returned: 0 in 0.960s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:35 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] Lock "cinder-quobyte-d0d6b587-5504-40be-8266-24e84cce9a49" acquired by "delete_volume" :: waited 0.041s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:35 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748 Jul 03 14:17:35 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:35 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[61230f3a-dd7e-4fd1-bdad-14138e7264cb]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d0d6b587-5504-40be-8266-24e84cce9a49 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:35 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d0d6b587-5504-40be-8266-24e84cce9a49 Jul 03 14:17:35 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:36 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602.23f55f5b-9726-4aa5-bd5a-4160bfd6f748" returned: 0 in 0.738s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] Lock "cinder-quobyte-23f55f5b-9726-4aa5-bd5a-4160bfd6f748" released by "_delete_snapshot" :: held 4.025s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] Lock "cinder-quobyte-e1cbe814-7511-465c-bfd2-5d0919283602" released by "delete_snapshot" :: held 4.058s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:36 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] Created reservations ['dce12a70-9ab6-4dcb-8e31-e02d477fe127', '1630e478-991b-4b08-87d5-339852760f02', '94dc21c4-8077-4a71-b0b2-893df44f648a', 'bb926479-c85e-43a8-a169-740954765de9'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:36 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] Delete snapshot completed successfully. Jul 03 14:17:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e2807570-5184-4f26-bd51-514256dd80ea tempest-CinderUnicodeTest-1882744731 None] Lock "cinder-23f55f5b-9726-4aa5-bd5a-4160bfd6f748-delete_snapshot" released by "delete_snapshot" :: held 4.248s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:36 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d0d6b587-5504-40be-8266-24e84cce9a49" returned: 0 in 0.892s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d0d6b587-5504-40be-8266-24e84cce9a49 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:36 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d0d6b587-5504-40be-8266-24e84cce9a49 Jul 03 14:17:36 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:37 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d0d6b587-5504-40be-8266-24e84cce9a49" returned: 0 in 0.713s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] Lock "cinder-quobyte-d0d6b587-5504-40be-8266-24e84cce9a49" released by "delete_volume" :: held 1.666s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:37 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] Created reservations ['8680bc6c-ba4e-4855-8aa2-15dabb20088e', 'e469f489-ada7-4b78-9677-ab354d8b2c1c', '439b2c17-0837-4f1e-836f-c5d982887d9b', 'e1f50721-5111-47a4-8bd9-802fefba3615'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:37 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-626bf2b3-dbf8-4085-8ae2-6f710f8a8cd7 tempest-ProjectAdminTests-28654423 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7272872924805, 'free_capacity_gb': 1775.7272872924805, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86805) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 14:17:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:37 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:17:37 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] Acquiring lock "cinder-e1cbe814-7511-465c-bfd2-5d0919283602-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] Lock "cinder-e1cbe814-7511-465c-bfd2-5d0919283602-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] Acquiring lock "cinder-quobyte-e1cbe814-7511-465c-bfd2-5d0919283602" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] Lock "cinder-quobyte-e1cbe814-7511-465c-bfd2-5d0919283602" acquired by "delete_volume" :: waited 0.028s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:37 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[583743c8-f978-4b81-8bd3-c793a6b94e23]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:38 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602 Jul 03 14:17:38 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:38 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.803s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:17:38 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] Deleted volume successfully. Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-09572ded-b451-4afb-8e9e-bea94620b05f tempest-ProjectReaderTests-943659594 None] Lock "cinder-d0d6b587-5504-40be-8266-24e84cce9a49-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Flow 'volume_create_manager' (6eee8a91-18c4-436c-97ee-2f1f3b58091e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab65758-2156-48fe-9b8d-e2475b3e8fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab65758-2156-48fe-9b8d-e2475b3e8fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-909043098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fca586-d3c1-4cd1-becc-e2d89ba29c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e1d4776bcf491b8995156ce52530e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:39Z,use_quota=True,user_id='7e781bb0c05e45a2921a15cb08df5c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2aa6f5e-88c3-45a8-97e6-f4beb245715d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2aa6f5e-88c3-45a8-97e6-f4beb245715d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b970d1c-0c8e-4a37-9601-97d8266f89d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b970d1c-0c8e-4a37-9601-97d8266f89d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09fca586-d3c1-4cd1-becc-e2d89ba29c91', 'volume_name': 'volume-09fca586-d3c1-4cd1-becc-e2d89ba29c91', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60f6878-b671-46c1-8bc9-00ff43491ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60f6878-b671-46c1-8bc9-00ff43491ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2819f73-f1c5-4c5d-80fa-c3484738f198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:38 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Volume 09fca586-d3c1-4cd1-becc-e2d89ba29c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09fca586-d3c1-4cd1-becc-e2d89ba29c91', 'volume_size': 1} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-909043098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fca586-d3c1-4cd1-becc-e2d89ba29c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e1d4776bcf491b8995156ce52530e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:39Z,use_quota=True,user_id='7e781bb0c05e45a2921a15cb08df5c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Creating volume 09fca586-d3c1-4cd1-becc-e2d89ba29c91 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:17:38 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09fca586-d3c1-4cd1-becc-e2d89ba29c91 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:38 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09fca586-d3c1-4cd1-becc-e2d89ba29c91 1073741824 Jul 03 14:17:38 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:38 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602" returned: 0 in 1.004s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:39 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602 Jul 03 14:17:39 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:39 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-e1cbe814-7511-465c-bfd2-5d0919283602" returned: 0 in 0.778s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:39 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09fca586-d3c1-4cd1-becc-e2d89ba29c91 1073741824" returned: 0 in 1.080s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] Lock "cinder-quobyte-e1cbe814-7511-465c-bfd2-5d0919283602" released by "delete_volume" :: held 1.873s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09fca586-d3c1-4cd1-becc-e2d89ba29c91 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:39 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09fca586-d3c1-4cd1-becc-e2d89ba29c91 Jul 03 14:17:39 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:39 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] Created reservations ['12aaa4fd-e91f-467d-b355-8b10a8606731', '0531ffdc-4f31-4e6f-ab21-64fc1aa9fe7f', 'be0d9b2c-33f0-4117-86d3-7ca5b7a9be1f', 'db1d0da7-f69c-4a0b-aa4d-3b9edc3742e3'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:40 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:17:40 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] Acquiring lock "cinder-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] Lock "cinder-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] Acquiring lock "cinder-quobyte-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] Lock "cinder-quobyte-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9" acquired by "delete_volume" :: waited 0.035s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9763781-0770-4af8-a79c-4503a4ece2ee]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:40 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9 Jul 03 14:17:40 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:40 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09fca586-d3c1-4cd1-becc-e2d89ba29c91" returned: 0 in 1.019s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2819f73-f1c5-4c5d-80fa-c3484738f198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09fca586-d3c1-4cd1-becc-e2d89ba29c91', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ff8ff8-14e9-4f5d-a53e-90203b69c743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:40 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Volume volume-09fca586-d3c1-4cd1-becc-e2d89ba29c91 (09fca586-d3c1-4cd1-becc-e2d89ba29c91): created successfully Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ff8ff8-14e9-4f5d-a53e-90203b69c743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Flow 'volume_create_manager' (6eee8a91-18c4-436c-97ee-2f1f3b58091e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:40 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:40 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-8711b78c-c4d2-4c34-ae16-7860e8d4f261 tempest-ProjectReaderTests-943659594 None] Created volume successfully. Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.918s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:17:40 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] Deleted volume successfully. Jul 03 14:17:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-4bb7dbea-f78b-488f-a2e3-c61f44fbb37d tempest-CinderUnicodeTest-1882744731 None] Lock "cinder-e1cbe814-7511-465c-bfd2-5d0919283602-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:41 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9" returned: 0 in 0.872s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:41 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9 Jul 03 14:17:41 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] Acquiring lock "cinder-09fca586-d3c1-4cd1-becc-e2d89ba29c91-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] Lock "cinder-09fca586-d3c1-4cd1-becc-e2d89ba29c91-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] Acquiring lock "cinder-quobyte-09fca586-d3c1-4cd1-becc-e2d89ba29c91" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] Lock "cinder-quobyte-09fca586-d3c1-4cd1-becc-e2d89ba29c91" acquired by "delete_volume" :: waited 0.021s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:41 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad27c667-5af4-4370-85f2-7e282c35d061]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09fca586-d3c1-4cd1-becc-e2d89ba29c91 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:41 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9" returned: 0 in 0.662s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] Lock "cinder-quobyte-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9" released by "delete_volume" :: held 1.626s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:42 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] Created reservations ['4ce5aa83-d306-4654-83d0-b58042d8b32d', 'c05198f6-46a0-4754-924d-163a3f36aca8', 'f62c9853-c475-43ba-a15c-f8ffdb5b3fdb', 'e7d7c23f-cb8c-4571-8e7d-0a99c3c31e27'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:42 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09fca586-d3c1-4cd1-becc-e2d89ba29c91 Jul 03 14:17:42 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:42 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:17:42 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:42 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.676s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:42 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:17:42 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] Deleted volume successfully. Jul 03 14:17:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e0e3abf6-8e4f-47b1-b3d8-7960873ee41b tempest-CinderUnicodeTest-1882744731 None] Lock "cinder-43d2b3d9-1085-4ce2-8375-1933c3e4b2e9-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:42 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09fca586-d3c1-4cd1-becc-e2d89ba29c91" returned: 0 in 0.958s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09fca586-d3c1-4cd1-becc-e2d89ba29c91 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:42 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09fca586-d3c1-4cd1-becc-e2d89ba29c91 Jul 03 14:17:42 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (1c9a4a88-39f8-4c8b-b1c6-347ee653534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4cf27f-87e0-4f24-8632-4250141bc066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4cf27f-87e0-4f24-8632-4250141bc066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1272482969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60dabf75-678f-40a6-8fb3-14877701ff9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:43Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338a6480-1025-4d02-baae-746f64b05615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338a6480-1025-4d02-baae-746f64b05615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8f9faa-052b-43f2-ab91-9655a326512f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8f9faa-052b-43f2-ab91-9655a326512f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60dabf75-678f-40a6-8fb3-14877701ff9e', 'volume_name': 'volume-60dabf75-678f-40a6-8fb3-14877701ff9e', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b85381-b475-4c70-8cc5-f5084dfe7253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b85381-b475-4c70-8cc5-f5084dfe7253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5421b26b-3d74-4bec-b3a2-264864291c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:43 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Volume 60dabf75-678f-40a6-8fb3-14877701ff9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60dabf75-678f-40a6-8fb3-14877701ff9e', 'volume_size': 1} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1272482969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60dabf75-678f-40a6-8fb3-14877701ff9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:43Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Creating volume 60dabf75-678f-40a6-8fb3-14877701ff9e {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:17:43 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:43 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e 1073741824 Jul 03 14:17:43 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:43 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-09fca586-d3c1-4cd1-becc-e2d89ba29c91" returned: 0 in 0.815s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] Lock "cinder-quobyte-09fca586-d3c1-4cd1-becc-e2d89ba29c91" released by "delete_volume" :: held 1.827s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] Created reservations ['7328a191-ee45-4536-87db-384ac9e15a57', '8bf6ca16-c360-495b-81e6-fdda725b563e', '3c419e7f-85ab-4ad6-9518-bbb7a1cf1de6', '45ca28ef-19c2-4294-8fc3-a437fd7c1796'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:43 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:17:43 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:44 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e 1073741824" returned: 0 in 1.093s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:44 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e Jul 03 14:17:44 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:44 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.728s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:44 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:17:44 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] Deleted volume successfully. Jul 03 14:17:44 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-376acc36-f589-4953-807f-461913cecb2d tempest-ProjectReaderTests-943659594 None] Lock "cinder-09fca586-d3c1-4cd1-becc-e2d89ba29c91-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:45 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e" returned: 0 in 0.786s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:17:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5421b26b-3d74-4bec-b3a2-264864291c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60dabf75-678f-40a6-8fb3-14877701ff9e', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d216f47-52a2-4d4c-aed7-1d2cc82fcb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:45 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Volume volume-60dabf75-678f-40a6-8fb3-14877701ff9e (60dabf75-678f-40a6-8fb3-14877701ff9e): created successfully Jul 03 14:17:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d216f47-52a2-4d4c-aed7-1d2cc82fcb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (1c9a4a88-39f8-4c8b-b1c6-347ee653534a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:45 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-fb29a74b-84ec-4846-a6d6-5ca9f73249cd tempest-ProjectMemberTests-789001210 None] Created volume successfully. Jul 03 14:17:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:46 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] Creating offline snapshot a5f43311-c1e1-4ac1-87cf-fecc62159334 of volume 60dabf75-678f-40a6-8fb3-14877701ff9e {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:17:46 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[34813663-77f1-48d6-90df-f92944f24cf2]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:47 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e Jul 03 14:17:47 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:47 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e" returned: 0 in 0.750s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:47 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334 1G Jul 03 14:17:47 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:48 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334 1G" returned: 0 in 0.895s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60dabf75-678f-40a6-8fb3-14877701ff9e -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:48 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60dabf75-678f-40a6-8fb3-14877701ff9e -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334 Jul 03 14:17:48 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:49 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60dabf75-678f-40a6-8fb3-14877701ff9e -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334" returned: 0 in 0.730s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:49 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334 is being set with open permissions: ugo+rw Jul 03 14:17:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:49 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334 Jul 03 14:17:49 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:50 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334" returned: 0 in 0.706s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:50 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.info Jul 03 14:17:50 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:50 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.info" returned: 0 in 0.749s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:50 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.info is being set with open permissions: ugo+rw Jul 03 14:17:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:50 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.info Jul 03 14:17:50 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:51 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.info" returned: 0 in 0.767s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.704s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:51 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-23e51bdf-8d31-4a4f-ad6c-433468faa384 tempest-ProjectMemberTests-789001210 None] Create snapshot completed successfully Jul 03 14:17:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-a5f43311-c1e1-4ac1-87cf-fecc62159334-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] Lock "cinder-a5f43311-c1e1-4ac1-87cf-fecc62159334-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-60dabf75-678f-40a6-8fb3-14877701ff9e" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-60dabf75-678f-40a6-8fb3-14877701ff9e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-a5f43311-c1e1-4ac1-87cf-fecc62159334" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:52 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-a5f43311-c1e1-4ac1-87cf-fecc62159334" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] Deleting offline snapshot a5f43311-c1e1-4ac1-87cf-fecc62159334 of volume 60dabf75-678f-40a6-8fb3-14877701ff9e {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:17:52 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] snapshot_file for this snap is: volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:17:52 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e44770b-3472-462f-a653-b029cf580df2]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:52 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334 Jul 03 14:17:52 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:53 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334" returned: 0 in 0.821s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60dabf75-678f-40a6-8fb3-14877701ff9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:17:53 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a16ec9-2acf-4b5b-807a-dac3c30ef515]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:53 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e Jul 03 14:17:53 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:53 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e" returned: 0 in 0.759s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:53 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334 Jul 03 14:17:53 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:54 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334" returned: 0 in 0.763s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:54 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334 Jul 03 14:17:54 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:55 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e.a5f43311-c1e1-4ac1-87cf-fecc62159334" returned: 0 in 0.753s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:55 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-a5f43311-c1e1-4ac1-87cf-fecc62159334" released by "_delete_snapshot" :: held 3.202s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:55 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-60dabf75-678f-40a6-8fb3-14877701ff9e" released by "delete_snapshot" :: held 3.227s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:55 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] Created reservations ['49966dd6-a94d-481c-b53a-c0e351792db5', '73cf5be1-6bc1-4f5f-90ab-e4e0c01b36cf', 'ea3a7614-0d2a-4ad5-a74c-620566aae5a8', '5dda73e6-3335-4e67-aee0-eb16aac4dc5b'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:55 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] Delete snapshot completed successfully. Jul 03 14:17:55 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-21ba7dd1-9f97-494e-afa8-d29252d5d7e0 tempest-ProjectMemberTests-789001210 None] Lock "cinder-a5f43311-c1e1-4ac1-87cf-fecc62159334-delete_snapshot" released by "delete_snapshot" :: held 3.379s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-60dabf75-678f-40a6-8fb3-14877701ff9e-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] Lock "cinder-60dabf75-678f-40a6-8fb3-14877701ff9e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-60dabf75-678f-40a6-8fb3-14877701ff9e" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:17:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-60dabf75-678f-40a6-8fb3-14877701ff9e" acquired by "delete_volume" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:17:56 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4654bea-89c7-43c0-87fd-1b455845a08f]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:17:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:56 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e Jul 03 14:17:56 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:57 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e" returned: 0 in 0.774s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:57 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e Jul 03 14:17:57 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:57 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-60dabf75-678f-40a6-8fb3-14877701ff9e" returned: 0 in 0.651s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-60dabf75-678f-40a6-8fb3-14877701ff9e" released by "delete_volume" :: held 1.488s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:58 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] Created reservations ['bb965c17-933a-4421-a04d-9728ddb2d0e3', 'e002ba55-e45e-4443-95c2-c67444fcb43e', 'd1857284-94b1-43ad-8396-c5c991d523cc', 'f9d73d08-d2aa-480b-bc14-103eb05f4cfa'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:17:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:58 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:17:58 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:17:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:58 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:17:58 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:17:58 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.656s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:58 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:17:58 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] Deleted volume successfully. Jul 03 14:17:58 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7a8e4d07-b3b5-4597-86c1-0b398c3e392a tempest-ProjectMemberTests-789001210 None] Lock "cinder-60dabf75-678f-40a6-8fb3-14877701ff9e-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (de068042-d728-49f0-8411-f0c9dee1f882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8444ff36-7ae6-4cdc-a13d-7d1521faeb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:59 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8444ff36-7ae6-4cdc-a13d-7d1521faeb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-420557332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e499d3-959e-43d1-a29b-dd4bc9a7bb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:59Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0e0be5-b392-4ee7-943f-3fbd02d176a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0e0be5-b392-4ee7-943f-3fbd02d176a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf5594e-c9f6-412f-ae0f-64cfccc0ddc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf5594e-c9f6-412f-ae0f-64cfccc0ddc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e499d3-959e-43d1-a29b-dd4bc9a7bb46', 'volume_name': 'volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de70168-c47e-4f04-a9d9-4ed052d1bd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de70168-c47e-4f04-a9d9-4ed052d1bd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04eeddea-18fb-4c46-a287-5bab52fc45d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:17:59 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Volume 97e499d3-959e-43d1-a29b-dd4bc9a7bb46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46', 'volume_size': 1} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-420557332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e499d3-959e-43d1-a29b-dd4bc9a7bb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:17:59Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Creating volume 97e499d3-959e-43d1-a29b-dd4bc9a7bb46 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:17:59 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.772s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:17:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:17:59 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46 1073741824 Jul 03 14:17:59 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:00 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46 1073741824" returned: 0 in 0.833s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:00 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46 Jul 03 14:18:00 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:00 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46" returned: 0 in 0.697s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:18:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:18:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04eeddea-18fb-4c46-a287-5bab52fc45d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba9553c-6ec0-4037-b584-dbf49faa4c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:00 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Volume volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46 (97e499d3-959e-43d1-a29b-dd4bc9a7bb46): created successfully Jul 03 14:18:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba9553c-6ec0-4037-b584-dbf49faa4c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (de068042-d728-49f0-8411-f0c9dee1f882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:18:00 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-936a5e81-d6eb-4def-b8d2-f5a340924aa2 tempest-ProjectMemberTests-789001210 None] Created volume successfully. Jul 03 14:18:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:18:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:18:01 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] Creating offline snapshot c9e2566f-44f1-47f1-b57b-b569ab02b2b0 of volume 97e499d3-959e-43d1-a29b-dd4bc9a7bb46 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:18:01 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d78aaaa-4f88-483b-b318-604730322c92]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:18:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:01 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46 Jul 03 14:18:01 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:02 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46" returned: 0 in 0.788s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:02 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0 1G Jul 03 14:18:02 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:02 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0 1G" returned: 0 in 0.771s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:02 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0 Jul 03 14:18:02 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:03 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0" returned: 0 in 0.711s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:03 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0 is being set with open permissions: ugo+rw Jul 03 14:18:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:03 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0 Jul 03 14:18:03 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:04 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0" returned: 0 in 0.605s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:04 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.info Jul 03 14:18:04 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:04 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.info" returned: 0 in 0.634s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:04 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.info is being set with open permissions: ugo+rw Jul 03 14:18:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:04 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.info Jul 03 14:18:04 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:05 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.info" returned: 0 in 0.637s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.225s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:18:05 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=125,cinder:INSERT=47,cinder:UPDATE=179,cinder:DELETE=14 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:18:05 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=183,cinder:INSERT=44,cinder:DELETE=16,cinder:SELECT=126 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:18:05 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b5ede559-e1ed-4acd-b4b7-9be247f8fb3f tempest-ProjectMemberTests-789001210 None] Create snapshot completed successfully Jul 03 14:18:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-c9e2566f-44f1-47f1-b57b-b569ab02b2b0-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:18:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] Lock "cinder-c9e2566f-44f1-47f1-b57b-b569ab02b2b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:18:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-97e499d3-959e-43d1-a29b-dd4bc9a7bb46" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:18:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-97e499d3-959e-43d1-a29b-dd4bc9a7bb46" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:18:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-c9e2566f-44f1-47f1-b57b-b569ab02b2b0" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:18:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-c9e2566f-44f1-47f1-b57b-b569ab02b2b0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:18:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] Deleting offline snapshot c9e2566f-44f1-47f1-b57b-b569ab02b2b0 of volume 97e499d3-959e-43d1-a29b-dd4bc9a7bb46 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:18:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] snapshot_file for this snap is: volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:18:06 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a84e5ea-4046-4617-899b-13d6ffb0edae]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:18:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:06 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0 Jul 03 14:18:06 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:07 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0" returned: 0 in 0.726s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:18:07 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ece86c0-e423-43fc-a827-d07516850675]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:18:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:07 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46 Jul 03 14:18:07 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:08 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46" returned: 0 in 0.717s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:08 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0 Jul 03 14:18:08 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:08 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0" returned: 0 in 0.691s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:08 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0 Jul 03 14:18:08 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:09 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46.c9e2566f-44f1-47f1-b57b-b569ab02b2b0" returned: 0 in 0.601s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-c9e2566f-44f1-47f1-b57b-b569ab02b2b0" released by "_delete_snapshot" :: held 2.832s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:18:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-97e499d3-959e-43d1-a29b-dd4bc9a7bb46" released by "delete_snapshot" :: held 2.853s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:18:09 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] Created reservations ['3777f4fe-76d9-4456-a0cc-a5dbb633a59c', '5aef23e4-c647-4cee-a3db-40c0f56da97d', '79f2e07a-f0e1-4bf0-8874-5eed27c48ab9', 'b6348def-ee00-4c9f-90ad-c8e3d5207cdd'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:18:09 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] Delete snapshot completed successfully. Jul 03 14:18:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-960ead8a-0567-4ed7-909e-a51f7d67c95a tempest-ProjectMemberTests-789001210 None] Lock "cinder-c9e2566f-44f1-47f1-b57b-b569ab02b2b0-delete_snapshot" released by "delete_snapshot" :: held 2.988s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:18:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-97e499d3-959e-43d1-a29b-dd4bc9a7bb46-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:18:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] Lock "cinder-97e499d3-959e-43d1-a29b-dd4bc9a7bb46-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:18:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-97e499d3-959e-43d1-a29b-dd4bc9a7bb46" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:18:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-97e499d3-959e-43d1-a29b-dd4bc9a7bb46" acquired by "delete_volume" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:18:09 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1107b119-0f7f-41d8-a642-50d87e654136]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:18:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:10 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46 Jul 03 14:18:10 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:10 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46" returned: 0 in 0.719s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:10 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46 Jul 03 14:18:10 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:11 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-97e499d3-959e-43d1-a29b-dd4bc9a7bb46" returned: 0 in 0.623s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-97e499d3-959e-43d1-a29b-dd4bc9a7bb46" released by "delete_volume" :: held 1.395s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:18:11 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] Created reservations ['f1b4d109-eadc-43cb-97bd-f524d3a9ace2', 'cc9041aa-2d5d-4657-8357-115cf724cb7e', '82ede7fd-2983-44e1-8bd4-2ecb523221df', 'a7fabbf7-e9c3-40d6-9652-3666c094b1c0'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:18:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:18:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:18:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:18:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:18:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:18:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:11 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:18:11 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:12 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.630s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:18:12 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] Deleted volume successfully. Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b6b1463d-6f3b-4073-82ce-f56eef3405df tempest-ProjectMemberTests-789001210 None] Lock "cinder-97e499d3-959e-43d1-a29b-dd4bc9a7bb46-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (40378c1b-4727-4065-bbe6-e6ea541d88fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9368437d-067d-41f5-864d-8422724a893a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9368437d-067d-41f5-864d-8422724a893a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1493917477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636ab149-a432-4051-9b5c-aae3a6653e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:18:12Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc82f75-11b0-47a3-84a1-bc252c9e7d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc82f75-11b0-47a3-84a1-bc252c9e7d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5b5745-44a8-435d-8f94-409db7f46740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5b5745-44a8-435d-8f94-409db7f46740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '636ab149-a432-4051-9b5c-aae3a6653e8d', 'volume_name': 'volume-636ab149-a432-4051-9b5c-aae3a6653e8d', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eac7382-e73a-44f7-90d8-89842821fee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eac7382-e73a-44f7-90d8-89842821fee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad91ea76-7bf7-4d71-a4d5-17c1cddc8b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:12 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Volume 636ab149-a432-4051-9b5c-aae3a6653e8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-636ab149-a432-4051-9b5c-aae3a6653e8d', 'volume_size': 1} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1493917477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636ab149-a432-4051-9b5c-aae3a6653e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:18:12Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Creating volume 636ab149-a432-4051-9b5c-aae3a6653e8d {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:18:12 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:18:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:12 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d 1073741824 Jul 03 14:18:12 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:13 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d 1073741824" returned: 0 in 0.815s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:13 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d Jul 03 14:18:13 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:13 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d" returned: 0 in 0.608s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:18:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:18:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad91ea76-7bf7-4d71-a4d5-17c1cddc8b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-636ab149-a432-4051-9b5c-aae3a6653e8d', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9267d9a-3441-4ca8-af17-e96df60a645b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:14 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Volume volume-636ab149-a432-4051-9b5c-aae3a6653e8d (636ab149-a432-4051-9b5c-aae3a6653e8d): created successfully Jul 03 14:18:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9267d9a-3441-4ca8-af17-e96df60a645b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:14 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (40378c1b-4727-4065-bbe6-e6ea541d88fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:18:14 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-bb6eedbb-d5b5-4fa3-912c-06d91192845e tempest-ProjectMemberTests-789001210 None] Created volume successfully. Jul 03 14:18:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:18:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:18:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] Creating offline snapshot 3af9bb35-9fed-4d5b-a63b-02d894b8aaaa of volume 636ab149-a432-4051-9b5c-aae3a6653e8d {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:18:14 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f1ac6f-3790-40bb-a1a5-6969f037dc36]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:18:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:14 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d Jul 03 14:18:14 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:15 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d" returned: 0 in 0.752s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:15 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa 1G Jul 03 14:18:15 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:16 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa 1G" returned: 0 in 0.817s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-636ab149-a432-4051-9b5c-aae3a6653e8d -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:16 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-636ab149-a432-4051-9b5c-aae3a6653e8d -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa Jul 03 14:18:16 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:16 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-636ab149-a432-4051-9b5c-aae3a6653e8d -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa" returned: 0 in 0.701s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:16 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa is being set with open permissions: ugo+rw Jul 03 14:18:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:16 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa Jul 03 14:18:16 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:17 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa" returned: 0 in 0.625s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:17 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.info Jul 03 14:18:17 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:18 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.info" returned: 0 in 0.657s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:18 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.info is being set with open permissions: ugo+rw Jul 03 14:18:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:18 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.info Jul 03 14:18:18 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:18 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.info" returned: 0 in 0.630s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.261s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:18:18 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ab294f30-c6fc-4bff-8a13-154f8b92a428 tempest-ProjectMemberTests-789001210 None] Create snapshot completed successfully Jul 03 14:18:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-3af9bb35-9fed-4d5b-a63b-02d894b8aaaa-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:18:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] Lock "cinder-3af9bb35-9fed-4d5b-a63b-02d894b8aaaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:18:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-636ab149-a432-4051-9b5c-aae3a6653e8d" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:18:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-636ab149-a432-4051-9b5c-aae3a6653e8d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:18:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-3af9bb35-9fed-4d5b-a63b-02d894b8aaaa" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:18:19 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-3af9bb35-9fed-4d5b-a63b-02d894b8aaaa" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:18:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] Deleting offline snapshot 3af9bb35-9fed-4d5b-a63b-02d894b8aaaa of volume 636ab149-a432-4051-9b5c-aae3a6653e8d {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:18:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] snapshot_file for this snap is: volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:18:19 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[23704ad5-6e3b-406d-81f4-01c782c4f34b]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:18:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:20 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa Jul 03 14:18:20 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:20 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa" returned: 0 in 0.740s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-636ab149-a432-4051-9b5c-aae3a6653e8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:18:20 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9e1ba3-4880-4c22-8994-51f82877468f]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:18:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:20 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d Jul 03 14:18:20 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:21 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d" returned: 0 in 0.732s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:21 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa Jul 03 14:18:21 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:22 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa" returned: 0 in 0.690s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:22 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa Jul 03 14:18:22 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:22 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d.3af9bb35-9fed-4d5b-a63b-02d894b8aaaa" returned: 0 in 0.609s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-3af9bb35-9fed-4d5b-a63b-02d894b8aaaa" released by "_delete_snapshot" :: held 2.854s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:18:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-636ab149-a432-4051-9b5c-aae3a6653e8d" released by "delete_snapshot" :: held 2.875s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:18:22 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] Created reservations ['88ee0440-426b-43de-bf7a-06427a0602e7', 'b45e4b2b-9c6d-4546-bf19-41a6dc242654', '65378b12-b6c0-486a-99bc-39a04c1095b1', 'c10e342a-ec26-4a8c-afc8-970d2b3e350b'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:18:22 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] Delete snapshot completed successfully. Jul 03 14:18:22 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-dd8eb923-4ad3-4d8d-a472-5c9c2f4da3df tempest-ProjectMemberTests-789001210 None] Lock "cinder-3af9bb35-9fed-4d5b-a63b-02d894b8aaaa-delete_snapshot" released by "delete_snapshot" :: held 3.007s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:18:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-636ab149-a432-4051-9b5c-aae3a6653e8d-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:18:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] Lock "cinder-636ab149-a432-4051-9b5c-aae3a6653e8d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:18:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-636ab149-a432-4051-9b5c-aae3a6653e8d" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:18:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-636ab149-a432-4051-9b5c-aae3a6653e8d" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:18:23 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fd99dc-11c3-4788-acaa-76e3f7fe4f2b]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:18:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:23 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d Jul 03 14:18:23 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:23 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d" returned: 0 in 0.743s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:23 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d Jul 03 14:18:23 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:24 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-636ab149-a432-4051-9b5c-aae3a6653e8d" returned: 0 in 0.643s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-636ab149-a432-4051-9b5c-aae3a6653e8d" released by "delete_volume" :: held 1.440s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:18:24 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] Created reservations ['5c56cc99-ce62-49f8-a989-c229ab6246f6', '6f2c1756-6c68-46e5-8665-7ce3c8a1ffd6', '08552fc1-1c2a-40d3-8563-ad1ad2104c6d', 'cfb4e7c9-bb2a-412d-90d3-ca4e8ec6712f'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:18:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:18:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:18:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:18:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:18:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:18:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:24 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:18:24 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:25 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.649s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:18:25 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] Deleted volume successfully. Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0e85794e-59d2-4073-b5cc-9d5e98aa71fa tempest-ProjectMemberTests-789001210 None] Lock "cinder-636ab149-a432-4051-9b5c-aae3a6653e8d-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (3252a9b8-47b6-4f85-b691-20f7ae5c652b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bad04d5-4ab5-4a92-b850-5f5d1fa4ae71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bad04d5-4ab5-4a92-b850-5f5d1fa4ae71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-634217815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5a00a8-664f-4ace-bd5f-1a2b8d697426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:18:26Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b414dde5-9293-4e43-881f-f514825ad4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b414dde5-9293-4e43-881f-f514825ad4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7883af65-8124-4872-bc1a-eaa968bf25ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7883af65-8124-4872-bc1a-eaa968bf25ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc5a00a8-664f-4ace-bd5f-1a2b8d697426', 'volume_name': 'volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3fb235-b64c-46ca-a795-16251430a707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3fb235-b64c-46ca-a795-16251430a707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b5a4e2-bd46-4fa5-97a6-53ba88ee9a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:25 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Volume fc5a00a8-664f-4ace-bd5f-1a2b8d697426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426', 'volume_size': 1} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-634217815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5a00a8-664f-4ace-bd5f-1a2b8d697426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:18:26Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Creating volume fc5a00a8-664f-4ace-bd5f-1a2b8d697426 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:18:25 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:18:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:25 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426 1073741824 Jul 03 14:18:25 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:26 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426 1073741824" returned: 0 in 0.851s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:26 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426 Jul 03 14:18:26 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:27 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426" returned: 0 in 0.649s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:18:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:18:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b5a4e2-bd46-4fa5-97a6-53ba88ee9a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e316b0d7-e4fd-4e84-b9a9-ac1509679a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:27 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Volume volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426 (fc5a00a8-664f-4ace-bd5f-1a2b8d697426): created successfully Jul 03 14:18:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e316b0d7-e4fd-4e84-b9a9-ac1509679a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:27 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (3252a9b8-47b6-4f85-b691-20f7ae5c652b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:18:27 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-80ef67ea-93d5-4ede-a371-818d01cfe8ef tempest-ProjectMemberTests-789001210 None] Created volume successfully. Jul 03 14:18:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:18:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:18:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] Creating offline snapshot b3e0483d-dbc9-4260-9923-866e87968412 of volume fc5a00a8-664f-4ace-bd5f-1a2b8d697426 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:18:27 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b05b13-ea28-4abe-a7ff-e84051635839]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:18:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:28 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426 Jul 03 14:18:28 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:28 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426" returned: 0 in 0.725s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:28 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412 1G Jul 03 14:18:28 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:29 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412 1G" returned: 0 in 0.755s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:29 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412 Jul 03 14:18:29 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:30 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412" returned: 0 in 0.680s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:30 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412 is being set with open permissions: ugo+rw Jul 03 14:18:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:30 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412 Jul 03 14:18:30 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:30 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412" returned: 0 in 0.617s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:30 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.info Jul 03 14:18:30 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:31 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.info" returned: 0 in 0.631s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:31 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.info is being set with open permissions: ugo+rw Jul 03 14:18:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:31 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.info Jul 03 14:18:31 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:32 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.info" returned: 0 in 0.617s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.104s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:18:32 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-d2a44b10-cff2-4213-94c5-bbff770db006 tempest-ProjectMemberTests-789001210 None] Create snapshot completed successfully Jul 03 14:18:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-b3e0483d-dbc9-4260-9923-866e87968412-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:18:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] Lock "cinder-b3e0483d-dbc9-4260-9923-866e87968412-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:18:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-fc5a00a8-664f-4ace-bd5f-1a2b8d697426" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:18:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-fc5a00a8-664f-4ace-bd5f-1a2b8d697426" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:18:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-b3e0483d-dbc9-4260-9923-866e87968412" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:18:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-b3e0483d-dbc9-4260-9923-866e87968412" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:18:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] Deleting offline snapshot b3e0483d-dbc9-4260-9923-866e87968412 of volume fc5a00a8-664f-4ace-bd5f-1a2b8d697426 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:18:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] snapshot_file for this snap is: volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:18:33 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[714f9c61-e80f-4468-9241-4bde4d95ab2c]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:18:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:33 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412 Jul 03 14:18:33 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:33 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412" returned: 0 in 0.725s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:18:34 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5496e6-bb9d-436a-8984-87955f84c421]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:18:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:34 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426 Jul 03 14:18:34 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:34 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426" returned: 0 in 0.735s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:34 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412 Jul 03 14:18:34 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:35 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412" returned: 0 in 0.699s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:35 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412 Jul 03 14:18:35 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:36 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426.b3e0483d-dbc9-4260-9923-866e87968412" returned: 0 in 0.613s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-b3e0483d-dbc9-4260-9923-866e87968412" released by "_delete_snapshot" :: held 2.860s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:18:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-fc5a00a8-664f-4ace-bd5f-1a2b8d697426" released by "delete_snapshot" :: held 2.890s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:18:36 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] Created reservations ['426ba5b7-fd58-4fa2-a016-d3b59966ce46', 'd6389e10-631c-47c0-9e54-61568a05c5ae', 'b1af9312-6e5b-48c6-9d12-b8ae90686c2d', '621e870c-cc22-4732-96f6-a27c22b87ed9'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:18:36 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] Delete snapshot completed successfully. Jul 03 14:18:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-78032c8a-7e94-4a9f-a0e1-5d70b9c3e939 tempest-ProjectMemberTests-789001210 None] Lock "cinder-b3e0483d-dbc9-4260-9923-866e87968412-delete_snapshot" released by "delete_snapshot" :: held 3.012s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:18:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-fc5a00a8-664f-4ace-bd5f-1a2b8d697426-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:18:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] Lock "cinder-fc5a00a8-664f-4ace-bd5f-1a2b8d697426-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:18:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-fc5a00a8-664f-4ace-bd5f-1a2b8d697426" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:18:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-fc5a00a8-664f-4ace-bd5f-1a2b8d697426" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:18:36 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3436c7e-bcd9-49b9-8af1-f38d79e5e51c]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:18:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:36 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426 Jul 03 14:18:36 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:37 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426" returned: 0 in 0.721s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:37 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426 Jul 03 14:18:37 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:37 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-fc5a00a8-664f-4ace-bd5f-1a2b8d697426" returned: 0 in 0.601s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-fc5a00a8-664f-4ace-bd5f-1a2b8d697426" released by "delete_volume" :: held 1.376s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:18:37 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] Created reservations ['72582649-24c1-44ce-9c56-be0d2c9112df', '1cde5976-3901-44bd-9fc9-60a321b5d396', 'ac062d4b-88e9-4826-aeab-0d956b2e5bb7', '334765e8-3652-4d94-bcf8-c097b7403612'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:18:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:18:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:18:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:18:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:18:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:18:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:37 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:18:37 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:38 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.608s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:38 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:18:38 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] Deleted volume successfully. Jul 03 14:18:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-406416f0-cb12-4977-a2ad-b81c2a36d829 tempest-ProjectMemberTests-789001210 None] Lock "cinder-fc5a00a8-664f-4ace-bd5f-1a2b8d697426-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:18:38 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:18:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (24cde99e-fd59-4824-8d9e-f141ad460f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:18:38 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b460d0ca-c8d9-4010-9eb8-0e9acbc409d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b460d0ca-c8d9-4010-9eb8-0e9acbc409d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81043544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adfcbc5e-b21e-4a72-a205-900f5a0e769f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:18:39Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88397b8d-5a20-4ead-815d-d40d0641d9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88397b8d-5a20-4ead-815d-d40d0641d9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f235decb-fd98-46d2-b4c3-211ea5fa314b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f235decb-fd98-46d2-b4c3-211ea5fa314b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adfcbc5e-b21e-4a72-a205-900f5a0e769f', 'volume_name': 'volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d1dcc46-1491-47ea-a85e-7289c2d19288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d1dcc46-1491-47ea-a85e-7289c2d19288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f7ea97-5b64-46ee-96bf-4bbe766b9d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:39 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Volume adfcbc5e-b21e-4a72-a205-900f5a0e769f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f', 'volume_size': 1} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81043544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adfcbc5e-b21e-4a72-a205-900f5a0e769f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:18:39Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Creating volume adfcbc5e-b21e-4a72-a205-900f5a0e769f {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:18:39 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:39 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f 1073741824 Jul 03 14:18:39 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:39 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f 1073741824" returned: 0 in 0.829s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:39 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f Jul 03 14:18:39 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:40 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f" returned: 0 in 0.661s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:18:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:18:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f7ea97-5b64-46ee-96bf-4bbe766b9d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070715c9-869d-4c83-8f9c-a43530fffbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:18:40 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Volume volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f (adfcbc5e-b21e-4a72-a205-900f5a0e769f): created successfully Jul 03 14:18:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070715c9-869d-4c83-8f9c-a43530fffbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:18:40 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (24cde99e-fd59-4824-8d9e-f141ad460f52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:18:40 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-d63ae072-9aec-44ae-8a2f-29b14d1fe140 tempest-ProjectMemberTests-789001210 None] Created volume successfully. Jul 03 14:18:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:18:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:18:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] Creating offline snapshot 7901352b-3399-4c9b-8da9-54947385d8ec of volume adfcbc5e-b21e-4a72-a205-900f5a0e769f {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:18:41 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[195c2664-80be-4cc0-8fa5-c9a166be7da0]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:18:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:41 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f Jul 03 14:18:41 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:41 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f" returned: 0 in 0.734s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f.7901352b-3399-4c9b-8da9-54947385d8ec 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:41 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f.7901352b-3399-4c9b-8da9-54947385d8ec 1G Jul 03 14:18:41 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:42 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f.7901352b-3399-4c9b-8da9-54947385d8ec 1G" returned: 0 in 0.757s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f.7901352b-3399-4c9b-8da9-54947385d8ec {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:42 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f.7901352b-3399-4c9b-8da9-54947385d8ec Jul 03 14:18:42 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:43 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f.7901352b-3399-4c9b-8da9-54947385d8ec" returned: 0 in 0.660s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:43 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f.7901352b-3399-4c9b-8da9-54947385d8ec is being set with open permissions: ugo+rw Jul 03 14:18:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f.7901352b-3399-4c9b-8da9-54947385d8ec {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:43 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f.7901352b-3399-4c9b-8da9-54947385d8ec Jul 03 14:18:43 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:43 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f.7901352b-3399-4c9b-8da9-54947385d8ec" returned: 0 in 0.611s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:44 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f.info Jul 03 14:18:44 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:44 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f.info" returned: 0 in 0.680s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:44 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f.info is being set with open permissions: ugo+rw Jul 03 14:18:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:44 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f.info Jul 03 14:18:44 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:45 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-adfcbc5e-b21e-4a72-a205-900f5a0e769f.info" returned: 0 in 0.626s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.154s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:18:45 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-50d5c4a0-3a5d-4a8c-923f-2b6bc9d70266 tempest-ProjectMemberTests-789001210 None] Create snapshot completed successfully Jul 03 14:18:46 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d741fe48-c09a-467e-97ef-416d08fdb081 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-7901352b-3399-4c9b-8da9-54947385d8ec-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:18:46 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d741fe48-c09a-467e-97ef-416d08fdb081 tempest-ProjectMemberTests-789001210 None] Lock "cinder-7901352b-3399-4c9b-8da9-54947385d8ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:18:46 devstack cinder-volume[86805]: INFO cinder.message.api [None req-d741fe48-c09a-467e-97ef-416d08fdb081 tempest-ProjectMemberTests-789001210 None] Creating message record for request_id = req-d741fe48-c09a-467e-97ef-416d08fdb081 Jul 03 14:18:46 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-d741fe48-c09a-467e-97ef-416d08fdb081 tempest-ProjectMemberTests-789001210 None] Lock "cinder-7901352b-3399-4c9b-8da9-54947385d8ec-delete_snapshot" released by "delete_snapshot" :: held 0.040s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server [None req-d741fe48-c09a-467e-97ef-416d08fdb081 tempest-ProjectMemberTests-789001210 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 219, in wrapper Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 14:18:46 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server Jul 03 14:18:55 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=44,cinder:UPDATE=50,cinder:INSERT=13,cinder:DELETE=6 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:18:56 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:DELETE=4,cinder:SELECT=42,cinder:INSERT=18,cinder:UPDATE=59 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:18:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:18:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:18:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:18:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:18:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:18:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:18:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:18:58 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:18:58 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:18:59 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 03 14:18:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.619s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:18:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:19:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:19:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:19:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:19:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:19:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:19:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:19:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:19:58 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:19:58 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:19:59 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 03 14:19:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.609s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:19:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:20:04 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:20:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:20:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:20:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:20:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:20:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:20:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:20:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:20:58 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:20:58 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:20:59 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 03 14:20:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.649s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:20:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:21:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:21:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:21:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:21:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:21:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:21:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:21:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:21:58 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:21:58 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:21:59 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 03 14:21:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.644s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:21:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (60173dda-a6d4-41e7-aade-bd6b663df75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd614fb6-4d01-4be6-b785-0692dc266caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd614fb6-4d01-4be6-b785-0692dc266caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-513037833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa11e1bf-6f03-4214-8cc3-cd463c377b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:22:03Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b1824e-ddda-4138-a43d-e36afd1337f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b1824e-ddda-4138-a43d-e36afd1337f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8160baed-2b2c-40e0-9df3-e82e79029089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8160baed-2b2c-40e0-9df3-e82e79029089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa11e1bf-6f03-4214-8cc3-cd463c377b4f', 'volume_name': 'volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2074ee0f-61d6-4219-8dd7-cc7b150c970e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2074ee0f-61d6-4219-8dd7-cc7b150c970e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde7f3dd-132a-458d-b30d-10fda5dbbe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:03 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Volume aa11e1bf-6f03-4214-8cc3-cd463c377b4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f', 'volume_size': 1} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-513037833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa11e1bf-6f03-4214-8cc3-cd463c377b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:22:03Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Creating volume aa11e1bf-6f03-4214-8cc3-cd463c377b4f {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:22:03 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:22:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:03 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f 1073741824 Jul 03 14:22:03 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:04 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f 1073741824" returned: 0 in 0.818s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:04 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f Jul 03 14:22:04 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:04 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f" returned: 0 in 0.632s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:04 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:22:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde7f3dd-132a-458d-b30d-10fda5dbbe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372e54b7-b908-453b-9c58-3ca4b209a541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:04 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Volume volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f (aa11e1bf-6f03-4214-8cc3-cd463c377b4f): created successfully Jul 03 14:22:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372e54b7-b908-453b-9c58-3ca4b209a541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:04 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (60173dda-a6d4-41e7-aade-bd6b663df75e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:22:04 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-d773c1c3-d2db-42d8-a0e5-f94761fa2257 tempest-ProjectMemberTests-789001210 None] Created volume successfully. Jul 03 14:22:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] Creating offline snapshot fe84f1d7-1433-4a1f-be85-177492b3f44f of volume aa11e1bf-6f03-4214-8cc3-cd463c377b4f {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:22:05 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7874b9-8f86-4dd3-93c8-008ed413dd6a]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:22:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:05 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f Jul 03 14:22:05 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:06 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f" returned: 0 in 0.728s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:06 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f 1G Jul 03 14:22:06 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:07 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f 1G" returned: 0 in 0.820s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:07 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f Jul 03 14:22:07 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:07 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f" returned: 0 in 0.678s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:07 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f is being set with open permissions: ugo+rw Jul 03 14:22:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:07 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f Jul 03 14:22:07 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:08 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f" returned: 0 in 0.627s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:08 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.info Jul 03 14:22:08 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:09 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.info" returned: 0 in 0.632s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:09 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.info is being set with open permissions: ugo+rw Jul 03 14:22:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:09 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.info Jul 03 14:22:09 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:09 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.info" returned: 0 in 0.617s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.181s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:09 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-704897ce-9af5-411c-a8eb-3c64e98ed618 tempest-ProjectMemberTests-789001210 None] Create snapshot completed successfully Jul 03 14:22:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-fe84f1d7-1433-4a1f-be85-177492b3f44f-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] Lock "cinder-fe84f1d7-1433-4a1f-be85-177492b3f44f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-aa11e1bf-6f03-4214-8cc3-cd463c377b4f" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-aa11e1bf-6f03-4214-8cc3-cd463c377b4f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-fe84f1d7-1433-4a1f-be85-177492b3f44f" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:10 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-fe84f1d7-1433-4a1f-be85-177492b3f44f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] Deleting offline snapshot fe84f1d7-1433-4a1f-be85-177492b3f44f of volume aa11e1bf-6f03-4214-8cc3-cd463c377b4f {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:22:10 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] snapshot_file for this snap is: volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:22:10 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f879bc0d-f113-490f-9d20-78a204b1d2d2]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:22:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:10 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f Jul 03 14:22:10 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:11 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f" returned: 0 in 0.741s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:22:11 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e0ff71-5a7b-4c9d-89da-1c58c9641c29]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:22:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:11 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f Jul 03 14:22:11 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:12 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f" returned: 0 in 0.716s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:12 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f Jul 03 14:22:12 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:12 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f" returned: 0 in 0.699s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:13 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f Jul 03 14:22:13 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:13 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f.fe84f1d7-1433-4a1f-be85-177492b3f44f" returned: 0 in 0.619s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-fe84f1d7-1433-4a1f-be85-177492b3f44f" released by "_delete_snapshot" :: held 2.863s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-aa11e1bf-6f03-4214-8cc3-cd463c377b4f" released by "delete_snapshot" :: held 2.884s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:13 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] Created reservations ['d36390bd-4698-4919-bc83-c6614c0415fb', 'a9b47f8f-02d7-4f64-b291-bb30e8d01594', '2ffb56b7-6f97-4341-8b4f-3ec4684f55cf', '7b57390e-86c5-4435-8640-480585c7ee58'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:22:13 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] Delete snapshot completed successfully. Jul 03 14:22:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-a06a6fc3-fb8d-4069-930a-3cab30d92c37 tempest-ProjectMemberTests-789001210 None] Lock "cinder-fe84f1d7-1433-4a1f-be85-177492b3f44f-delete_snapshot" released by "delete_snapshot" :: held 3.012s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-aa11e1bf-6f03-4214-8cc3-cd463c377b4f-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] Lock "cinder-aa11e1bf-6f03-4214-8cc3-cd463c377b4f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-aa11e1bf-6f03-4214-8cc3-cd463c377b4f" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-aa11e1bf-6f03-4214-8cc3-cd463c377b4f" acquired by "delete_volume" :: waited 0.013s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:14 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abba536-4780-436b-8107-710a5e2546d7]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:22:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:14 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f Jul 03 14:22:14 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:14 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f" returned: 0 in 0.728s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:14 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f Jul 03 14:22:14 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:15 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-aa11e1bf-6f03-4214-8cc3-cd463c377b4f" returned: 0 in 0.616s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:15 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-aa11e1bf-6f03-4214-8cc3-cd463c377b4f" released by "delete_volume" :: held 1.395s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:15 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] Created reservations ['806c860e-7405-4f05-8290-184dbc824e9a', '4ee52d37-337d-479d-af00-528c49412f23', '184da41f-adc7-4b41-91e2-a83e4f871ae6', 'b5b1183f-8e54-4e0f-8c64-d783732a25eb'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:22:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:22:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:22:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:15 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:22:15 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:16 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.626s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:22:16 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] Deleted volume successfully. Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6b5a263b-fafc-4dd8-81c1-650ad234c0db tempest-ProjectMemberTests-789001210 None] Lock "cinder-aa11e1bf-6f03-4214-8cc3-cd463c377b4f-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (d1f7f72f-47ff-4c1e-be1f-1e49feea8572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ef88a8-da4c-4971-a1a2-a565edd9c34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ef88a8-da4c-4971-a1a2-a565edd9c34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961586554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b097438-52b8-4f7c-ab74-4747219ca17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:22:17Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1efb94ad-f1de-41d0-92a0-e36f54ae5716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1efb94ad-f1de-41d0-92a0-e36f54ae5716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a692b301-bdfd-45c8-9b36-dfed036c1207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a692b301-bdfd-45c8-9b36-dfed036c1207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b097438-52b8-4f7c-ab74-4747219ca17a', 'volume_name': 'volume-2b097438-52b8-4f7c-ab74-4747219ca17a', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6563024f-d832-425f-9733-5c4d2ca034e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6563024f-d832-425f-9733-5c4d2ca034e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d873e5df-087a-4250-b722-a34b1ed3df1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:16 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Volume 2b097438-52b8-4f7c-ab74-4747219ca17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b097438-52b8-4f7c-ab74-4747219ca17a', 'volume_size': 1} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961586554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b097438-52b8-4f7c-ab74-4747219ca17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:22:17Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Creating volume 2b097438-52b8-4f7c-ab74-4747219ca17a {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:22:16 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:22:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:16 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a 1073741824 Jul 03 14:22:16 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:17 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a 1073741824" returned: 0 in 0.826s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:17 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a Jul 03 14:22:17 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:18 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a" returned: 0 in 0.620s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:22:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d873e5df-087a-4250-b722-a34b1ed3df1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b097438-52b8-4f7c-ab74-4747219ca17a', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92eaa7b3-7437-47c3-b716-4a1f2886ffc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:18 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Volume volume-2b097438-52b8-4f7c-ab74-4747219ca17a (2b097438-52b8-4f7c-ab74-4747219ca17a): created successfully Jul 03 14:22:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92eaa7b3-7437-47c3-b716-4a1f2886ffc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (d1f7f72f-47ff-4c1e-be1f-1e49feea8572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:22:18 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-8b7ba9f0-3ff6-47b5-91eb-d999a217c912 tempest-ProjectMemberTests-789001210 None] Created volume successfully. Jul 03 14:22:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] Creating offline snapshot 1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2 of volume 2b097438-52b8-4f7c-ab74-4747219ca17a {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:22:18 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db2706c-9801-4856-8094-aa3fbd9672b8]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:22:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:18 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a Jul 03 14:22:18 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:19 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a" returned: 0 in 0.726s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:19 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2 1G Jul 03 14:22:19 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:20 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2 1G" returned: 0 in 0.817s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b097438-52b8-4f7c-ab74-4747219ca17a -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:20 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b097438-52b8-4f7c-ab74-4747219ca17a -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2 Jul 03 14:22:20 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:21 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b097438-52b8-4f7c-ab74-4747219ca17a -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2" returned: 0 in 0.684s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:21 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2 is being set with open permissions: ugo+rw Jul 03 14:22:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:21 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2 Jul 03 14:22:21 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:21 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2" returned: 0 in 0.642s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:21 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.info Jul 03 14:22:21 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:22 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.info" returned: 0 in 0.621s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:22 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.info is being set with open permissions: ugo+rw Jul 03 14:22:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:22 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.info Jul 03 14:22:22 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:23 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.info" returned: 0 in 0.627s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.191s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:23 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f7e0644d-e127-4413-a5dd-00d93372573c tempest-ProjectMemberTests-789001210 None] Create snapshot completed successfully Jul 03 14:22:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] Lock "cinder-1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-2b097438-52b8-4f7c-ab74-4747219ca17a" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-2b097438-52b8-4f7c-ab74-4747219ca17a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:24 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] Deleting offline snapshot 1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2 of volume 2b097438-52b8-4f7c-ab74-4747219ca17a {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:22:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] snapshot_file for this snap is: volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:22:24 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f31509a-43ad-4b77-9da3-66def4e92b52]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:22:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:24 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2 Jul 03 14:22:24 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:24 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2" returned: 0 in 0.758s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:24 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b097438-52b8-4f7c-ab74-4747219ca17a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:22:24 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfad047-cf69-44b7-8e66-96c44c096fb7]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:22:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:25 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a Jul 03 14:22:25 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:25 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a" returned: 0 in 0.823s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:25 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2 Jul 03 14:22:25 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:26 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2" returned: 0 in 0.823s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:26 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2 Jul 03 14:22:26 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:27 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a.1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2" returned: 0 in 0.662s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2" released by "_delete_snapshot" :: held 3.156s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-2b097438-52b8-4f7c-ab74-4747219ca17a" released by "delete_snapshot" :: held 3.179s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:27 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] Created reservations ['9e6d2cb9-05cc-47b8-a823-3b8a228703c2', '751384e6-c174-43f2-82ee-e9b2f109a664', '1cf07c80-c6d1-4d13-9079-7968e4d1e5c5', '4990201c-be04-4185-93c4-2b8dab5d0a69'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:22:27 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] Delete snapshot completed successfully. Jul 03 14:22:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-0cb4fb19-cd15-44ff-84bd-329bc77afbac tempest-ProjectMemberTests-789001210 None] Lock "cinder-1a4cfd55-4870-4e9a-a1b2-d67c28ffcaa2-delete_snapshot" released by "delete_snapshot" :: held 3.321s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-2b097438-52b8-4f7c-ab74-4747219ca17a-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] Lock "cinder-2b097438-52b8-4f7c-ab74-4747219ca17a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-2b097438-52b8-4f7c-ab74-4747219ca17a" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-2b097438-52b8-4f7c-ab74-4747219ca17a" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:28 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d04b25d-28a4-40c1-8f43-f8f37ef82161]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:22:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:28 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a Jul 03 14:22:28 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:29 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a" returned: 0 in 0.759s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:29 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a Jul 03 14:22:29 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:29 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2b097438-52b8-4f7c-ab74-4747219ca17a" returned: 0 in 0.618s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-2b097438-52b8-4f7c-ab74-4747219ca17a" released by "delete_volume" :: held 1.438s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:29 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] Created reservations ['9c6c26c8-45ad-47e6-8aed-c12fbab37a6f', '1c335acc-59fa-42be-9250-594a3855c800', '3d54a53c-9c38-499c-aea5-be134d724faa', '1bfab029-6009-4768-a180-bf109f70d758'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:22:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:22:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:22:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:29 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:22:29 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:30 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.661s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:30 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:22:30 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] Deleted volume successfully. Jul 03 14:22:30 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-764857c2-f052-4d3e-9604-0b95933f7ffb tempest-ProjectMemberTests-789001210 None] Lock "cinder-2b097438-52b8-4f7c-ab74-4747219ca17a-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:30 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:22:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (1d7935be-68b5-4202-a792-610e7a14244c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:22:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b8f3d9-2333-4e13-9355-f5c1a7cc5c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b8f3d9-2333-4e13-9355-f5c1a7cc5c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-357532971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:22:31Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801494e2-2dbc-437c-a6f1-7a8a171a71f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801494e2-2dbc-437c-a6f1-7a8a171a71f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4430530-4251-465b-97a8-b8d7488b5af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4430530-4251-465b-97a8-b8d7488b5af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5', 'volume_name': 'volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180e3973-e5ff-4919-87d6-67df2cc0902e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180e3973-e5ff-4919-87d6-67df2cc0902e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c489fd-2c80-471a-a7c8-8423185ed54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:31 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Volume 96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5', 'volume_size': 1} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-357532971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:22:31Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Creating volume 96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:22:31 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:31 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 1073741824 Jul 03 14:22:31 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:31 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 1073741824" returned: 0 in 0.801s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:31 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 Jul 03 14:22:31 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:32 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5" returned: 0 in 0.612s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:22:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c489fd-2c80-471a-a7c8-8423185ed54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf800b0-ebeb-4d18-81aa-2bc22ce0016e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:32 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Volume volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 (96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5): created successfully Jul 03 14:22:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf800b0-ebeb-4d18-81aa-2bc22ce0016e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (1d7935be-68b5-4202-a792-610e7a14244c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:22:32 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-9d293804-aa5f-487f-b741-6f4165d2b08c tempest-ProjectMemberTests-789001210 None] Created volume successfully. Jul 03 14:22:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] Creating offline snapshot e4fa11e2-f137-4962-927b-6f0252e98402 of volume 96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:22:33 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3810ae5-d959-44ac-b2ec-ed44a7dd2088]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:22:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:33 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 Jul 03 14:22:33 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:34 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5" returned: 0 in 0.828s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:34 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402 1G Jul 03 14:22:34 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:34 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402 1G" returned: 0 in 0.770s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:34 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402 Jul 03 14:22:34 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:35 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402" returned: 0 in 0.684s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:35 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402 is being set with open permissions: ugo+rw Jul 03 14:22:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:35 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402 Jul 03 14:22:35 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:36 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402" returned: 0 in 0.736s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:36 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.info Jul 03 14:22:36 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:36 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.info" returned: 0 in 0.728s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:36 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.info is being set with open permissions: ugo+rw Jul 03 14:22:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:37 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.info Jul 03 14:22:37 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:37 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.info" returned: 0 in 0.727s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.559s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:37 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-68965bd5-2bc9-480d-b78e-29d1f3f7dee2 tempest-ProjectMemberTests-789001210 None] Create snapshot completed successfully Jul 03 14:22:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-e4fa11e2-f137-4962-927b-6f0252e98402-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] Lock "cinder-e4fa11e2-f137-4962-927b-6f0252e98402-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-e4fa11e2-f137-4962-927b-6f0252e98402" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-e4fa11e2-f137-4962-927b-6f0252e98402" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] Deleting offline snapshot e4fa11e2-f137-4962-927b-6f0252e98402 of volume 96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:22:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] snapshot_file for this snap is: volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:22:38 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb31a3f3-80c6-4ded-9aa3-5e24dc89c1aa]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:22:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:38 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402 Jul 03 14:22:38 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:39 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402" returned: 0 in 0.751s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:22:39 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9d6952-7cf0-4357-b1eb-f7a1f19d5055]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:22:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:39 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 Jul 03 14:22:39 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:40 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5" returned: 0 in 0.766s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:40 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402 Jul 03 14:22:40 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:40 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402" returned: 0 in 0.761s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:40 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402 Jul 03 14:22:40 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:41 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5.e4fa11e2-f137-4962-927b-6f0252e98402" returned: 0 in 0.668s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-e4fa11e2-f137-4962-927b-6f0252e98402" released by "_delete_snapshot" :: held 3.036s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5" released by "delete_snapshot" :: held 3.058s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:41 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] Created reservations ['55376d57-6ef1-40cf-9636-6904e575e532', '7e1a3a0c-550e-4bb6-bb5b-dd8b169a035e', 'c08a0a12-84dc-41bc-a570-68208395b02f', '04b7880b-827e-4104-a136-de2ae450ba95'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:22:41 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] Delete snapshot completed successfully. Jul 03 14:22:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-e6058026-dccb-4644-b343-08b9147a46ab tempest-ProjectMemberTests-789001210 None] Lock "cinder-e4fa11e2-f137-4962-927b-6f0252e98402-delete_snapshot" released by "delete_snapshot" :: held 3.199s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] Lock "cinder-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:43 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2efc142-c336-451a-a4a4-61fb24a110df]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:22:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:43 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 Jul 03 14:22:43 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:43 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5" returned: 0 in 0.788s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:43 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5 Jul 03 14:22:43 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:44 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5" returned: 0 in 0.669s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:44 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5" released by "delete_volume" :: held 1.516s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:44 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=46,cinder:SELECT=38,cinder:INSERT=13,cinder:DELETE=3 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:22:44 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] Created reservations ['8e25dea3-55b5-48a8-a213-42618570d019', '7a7af546-b707-4b29-8a0a-44a734e609a6', '56b264c4-da73-4e7b-9bca-8a940b7c589a', '234fbef5-3065-45c3-a0f4-9f45bced6f28'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:22:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:22:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:22:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:44 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:22:44 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:45 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.702s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:22:45 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] Deleted volume successfully. Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-7e77a280-4d45-451c-ad3f-29bbc7a49b1d tempest-ProjectMemberTests-789001210 None] Lock "cinder-96ae6a4c-e3af-4eeb-9541-5c1b2a8bffb5-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (f48bfbc1-95ee-43ee-909d-2306e47b65f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a7a00a-ca90-4096-ab9f-151369ccac2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a7a00a-ca90-4096-ab9f-151369ccac2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1101464258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54278890-b957-4c58-a7a7-f4b56fb272c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:22:46Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365650d9-b441-4075-bea2-f79c22973efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365650d9-b441-4075-bea2-f79c22973efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14adb25d-b236-4676-b963-af0b1351e0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14adb25d-b236-4676-b963-af0b1351e0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54278890-b957-4c58-a7a7-f4b56fb272c7', 'volume_name': 'volume-54278890-b957-4c58-a7a7-f4b56fb272c7', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefd1b0c-2b94-46fd-97c6-75b8816f3ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefd1b0c-2b94-46fd-97c6-75b8816f3ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117e4258-78f5-4cc3-bde7-3eeeda399cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:45 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Volume 54278890-b957-4c58-a7a7-f4b56fb272c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54278890-b957-4c58-a7a7-f4b56fb272c7', 'volume_size': 1} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1101464258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54278890-b957-4c58-a7a7-f4b56fb272c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:22:46Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Creating volume 54278890-b957-4c58-a7a7-f4b56fb272c7 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:22:45 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:22:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:45 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7 1073741824 Jul 03 14:22:45 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:46 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7 1073741824" returned: 0 in 0.799s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:46 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=47,cinder:UPDATE=55,cinder:DELETE=6,cinder:INSERT=15 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:22:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:46 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7 Jul 03 14:22:46 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:47 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7" returned: 0 in 0.619s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:22:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117e4258-78f5-4cc3-bde7-3eeeda399cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54278890-b957-4c58-a7a7-f4b56fb272c7', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d18771-15bc-4644-8622-92c41cfd6f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:47 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Volume volume-54278890-b957-4c58-a7a7-f4b56fb272c7 (54278890-b957-4c58-a7a7-f4b56fb272c7): created successfully Jul 03 14:22:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d18771-15bc-4644-8622-92c41cfd6f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:47 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (f48bfbc1-95ee-43ee-909d-2306e47b65f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:22:47 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-dc685844-ca71-4a29-b83f-06ed4595e030 tempest-ProjectMemberTests-789001210 None] Created volume successfully. Jul 03 14:22:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:47 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] Creating offline snapshot 7f68ffa5-e5fd-4d92-a593-01a9acf0f039 of volume 54278890-b957-4c58-a7a7-f4b56fb272c7 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:22:47 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[03339876-581f-4f89-9b10-e3f9fef48028]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:22:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:47 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7 Jul 03 14:22:47 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:48 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7" returned: 0 in 0.846s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:48 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039 1G Jul 03 14:22:48 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:49 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039 1G" returned: 0 in 0.856s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:49 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54278890-b957-4c58-a7a7-f4b56fb272c7 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:49 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54278890-b957-4c58-a7a7-f4b56fb272c7 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039 Jul 03 14:22:49 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:50 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54278890-b957-4c58-a7a7-f4b56fb272c7 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039" returned: 0 in 0.657s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:50 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039 is being set with open permissions: ugo+rw Jul 03 14:22:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:50 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039 Jul 03 14:22:50 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:50 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039" returned: 0 in 0.705s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:50 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:50 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.info Jul 03 14:22:50 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:51 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.info" returned: 0 in 0.619s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:51 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.info is being set with open permissions: ugo+rw Jul 03 14:22:51 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:51 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.info Jul 03 14:22:51 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:52 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.info" returned: 0 in 0.601s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:52 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.363s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:52 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-d29391c8-9db6-423f-8d33-862ef681ab2c tempest-ProjectMemberTests-789001210 None] Create snapshot completed successfully Jul 03 14:22:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-7f68ffa5-e5fd-4d92-a593-01a9acf0f039-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] Lock "cinder-7f68ffa5-e5fd-4d92-a593-01a9acf0f039-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-54278890-b957-4c58-a7a7-f4b56fb272c7" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-54278890-b957-4c58-a7a7-f4b56fb272c7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-7f68ffa5-e5fd-4d92-a593-01a9acf0f039" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:53 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-7f68ffa5-e5fd-4d92-a593-01a9acf0f039" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] Deleting offline snapshot 7f68ffa5-e5fd-4d92-a593-01a9acf0f039 of volume 54278890-b957-4c58-a7a7-f4b56fb272c7 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:22:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] snapshot_file for this snap is: volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:22:53 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d92fdc8-812a-41d0-a2a6-c23827bdd47e]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:22:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:53 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039 Jul 03 14:22:53 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:53 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:53 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039" returned: 0 in 0.748s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:53 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54278890-b957-4c58-a7a7-f4b56fb272c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:22:54 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8027093e-d831-4993-b961-99782713a3f0]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:22:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:54 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7 Jul 03 14:22:54 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:54 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7" returned: 0 in 0.718s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:54 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:54 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039 Jul 03 14:22:54 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:55 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039" returned: 0 in 0.743s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:55 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:55 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039 Jul 03 14:22:55 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:56 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7.7f68ffa5-e5fd-4d92-a593-01a9acf0f039" returned: 0 in 0.603s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-7f68ffa5-e5fd-4d92-a593-01a9acf0f039" released by "_delete_snapshot" :: held 2.902s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-54278890-b957-4c58-a7a7-f4b56fb272c7" released by "delete_snapshot" :: held 2.925s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:56 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] Created reservations ['489d71e7-3cbd-4d0f-8273-08afe225dbdb', '8e4cfad4-5111-4f7b-8c3d-0b9bb5ed97f1', '3680b4ec-560c-463d-a850-5b946c8aec7b', 'f1a7d658-4d9b-4e1f-b95b-6558fbd05058'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:22:56 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] Delete snapshot completed successfully. Jul 03 14:22:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f187be94-09a0-4ad9-9161-c37a66c12ce1 tempest-ProjectMemberTests-789001210 None] Lock "cinder-7f68ffa5-e5fd-4d92-a593-01a9acf0f039-delete_snapshot" released by "delete_snapshot" :: held 3.045s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-54278890-b957-4c58-a7a7-f4b56fb272c7-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] Lock "cinder-54278890-b957-4c58-a7a7-f4b56fb272c7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-54278890-b957-4c58-a7a7-f4b56fb272c7" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:22:56 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-54278890-b957-4c58-a7a7-f4b56fb272c7" acquired by "delete_volume" :: waited 0.014s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:22:56 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d243cd-5588-459d-86aa-2d162c4fffb4]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:22:56 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:56 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7 Jul 03 14:22:56 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:57 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7" returned: 0 in 0.724s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:57 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7 Jul 03 14:22:57 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:57 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-54278890-b957-4c58-a7a7-f4b56fb272c7" returned: 0 in 0.623s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:57 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-54278890-b957-4c58-a7a7-f4b56fb272c7" released by "delete_volume" :: held 1.405s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:57 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] Created reservations ['46c78a53-14a7-4ada-8fd5-0b7a6c88ca10', '4b6ca05c-e567-4b4d-aca0-a1acad872517', '4161156a-7e42-41ff-8edd-c09ce4e3868d', 'd1afb2b9-4734-46d3-9fb4-162be5be5f8d'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:22:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:57 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:22:57 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:22:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:57 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:57 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:22:57 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:22:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:22:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:22:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:58 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:22:58 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:58 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.633s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:58 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:22:58 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] Deleted volume successfully. Jul 03 14:22:58 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f7a1e4a3-d7ec-454e-876e-2c5714d8957d tempest-ProjectMemberTests-789001210 None] Lock "cinder-54278890-b957-4c58-a7a7-f4b56fb272c7-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (c5bfa531-50b0-422d-99ae-31731cc9efee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06a6f31-2957-4783-9a2f-d701356386f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06a6f31-2957-4783-9a2f-d701356386f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412891343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce279c2-85c5-4fb8-816c-f611d6002f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:22:59Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04cf81e5-201d-4667-958b-4780b6db9319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04cf81e5-201d-4667-958b-4780b6db9319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8efcf16-83dc-4b07-9eb5-9947414a297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8efcf16-83dc-4b07-9eb5-9947414a297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ce279c2-85c5-4fb8-816c-f611d6002f3f', 'volume_name': 'volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:59 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6195c851-daaa-4828-81ab-64b034386ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6195c851-daaa-4828-81ab-64b034386ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d503ac1-03cc-430d-9e12-8bc8c199a8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:22:59 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Volume 2ce279c2-85c5-4fb8-816c-f611d6002f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f', 'volume_size': 1} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412891343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce279c2-85c5-4fb8-816c-f611d6002f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c56fdbe97a4356a826cec24d7ff909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:22:59Z,use_quota=True,user_id='5277e352cf6e41dd88bf1b501f8bd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Creating volume 2ce279c2-85c5-4fb8-816c-f611d6002f3f {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:22:59 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.683s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:22:59 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f 1073741824 Jul 03 14:22:59 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:22:59 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f 1073741824" returned: 0 in 0.785s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:22:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:22:59 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f Jul 03 14:22:59 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:00 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f" returned: 0 in 0.624s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:00 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:23:00 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:23:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d503ac1-03cc-430d-9e12-8bc8c199a8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e2e78b9-6f5f-4e8d-9ab2-3578e4d03255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:00 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Volume volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f (2ce279c2-85c5-4fb8-816c-f611d6002f3f): created successfully Jul 03 14:23:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e2e78b9-6f5f-4e8d-9ab2-3578e4d03255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:00 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Flow 'volume_create_manager' (c5bfa531-50b0-422d-99ae-31731cc9efee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:23:00 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-40db2bb7-29be-4c25-8273-f024dfee9ca8 tempest-ProjectMemberTests-789001210 None] Created volume successfully. Jul 03 14:23:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:23:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:23:01 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] Creating offline snapshot 5e2fcde4-7582-4ea9-bfa1-545a27f1e99a of volume 2ce279c2-85c5-4fb8-816c-f611d6002f3f {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:23:01 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce8b11d-0589-4b31-8849-ddb72b5d7cb5]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:23:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:01 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f Jul 03 14:23:01 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:01 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f" returned: 0 in 0.722s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:01 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:01 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a 1G Jul 03 14:23:01 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:02 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a 1G" returned: 0 in 0.788s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:02 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:02 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a Jul 03 14:23:02 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:03 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a" returned: 0 in 0.743s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:03 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a is being set with open permissions: ugo+rw Jul 03 14:23:03 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:03 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a Jul 03 14:23:03 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:04 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a" returned: 0 in 0.618s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:04 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.info Jul 03 14:23:04 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:04 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.info" returned: 0 in 0.623s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:04 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.info is being set with open permissions: ugo+rw Jul 03 14:23:04 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:04 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.info Jul 03 14:23:04 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:05 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.info" returned: 0 in 0.625s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.194s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:23:05 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-7bae29fb-239d-4aae-b78e-8d13fbd45021 tempest-ProjectMemberTests-789001210 None] Create snapshot completed successfully Jul 03 14:23:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-5e2fcde4-7582-4ea9-bfa1-545a27f1e99a-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:23:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] Lock "cinder-5e2fcde4-7582-4ea9-bfa1-545a27f1e99a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:23:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-2ce279c2-85c5-4fb8-816c-f611d6002f3f" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:23:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-2ce279c2-85c5-4fb8-816c-f611d6002f3f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:23:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-5e2fcde4-7582-4ea9-bfa1-545a27f1e99a" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:23:06 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-5e2fcde4-7582-4ea9-bfa1-545a27f1e99a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:23:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] Deleting offline snapshot 5e2fcde4-7582-4ea9-bfa1-545a27f1e99a of volume 2ce279c2-85c5-4fb8-816c-f611d6002f3f {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:23:06 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] snapshot_file for this snap is: volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:23:06 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c0bd7c-992f-40c3-a0da-03a4bac96112]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:23:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:06 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a Jul 03 14:23:06 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:07 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a" returned: 0 in 0.734s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:23:07 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[563bd7d8-850b-4564-835d-3379db8dda6e]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:23:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:07 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f Jul 03 14:23:07 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:08 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f" returned: 0 in 0.745s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:08 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a Jul 03 14:23:08 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:08 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a" returned: 0 in 0.735s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:08 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a Jul 03 14:23:08 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:09 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f.5e2fcde4-7582-4ea9-bfa1-545a27f1e99a" returned: 0 in 0.665s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-5e2fcde4-7582-4ea9-bfa1-545a27f1e99a" released by "_delete_snapshot" :: held 2.961s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:23:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-2ce279c2-85c5-4fb8-816c-f611d6002f3f" released by "delete_snapshot" :: held 2.981s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:23:09 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] Created reservations ['319bffbc-71f9-4b5b-9c5a-e46c4640752e', '35b8c4ac-9654-4ddf-b4f9-269366067b44', 'c2c2e330-832a-47c7-8c8c-88eac575e201', '31c73912-b738-4c5f-a71c-ad962fad6506'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:23:09 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] Delete snapshot completed successfully. Jul 03 14:23:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-9d32e6cf-2953-4628-a681-6ac2b01f8427 tempest-ProjectMemberTests-789001210 None] Lock "cinder-5e2fcde4-7582-4ea9-bfa1-545a27f1e99a-delete_snapshot" released by "delete_snapshot" :: held 3.115s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:23:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-2ce279c2-85c5-4fb8-816c-f611d6002f3f-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:23:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] Lock "cinder-2ce279c2-85c5-4fb8-816c-f611d6002f3f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:23:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] Acquiring lock "cinder-quobyte-2ce279c2-85c5-4fb8-816c-f611d6002f3f" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:23:09 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-2ce279c2-85c5-4fb8-816c-f611d6002f3f" acquired by "delete_volume" :: waited 0.013s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:23:09 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce958edf-9fb6-40c0-aa83-f13e9cc635e0]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:23:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:09 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f Jul 03 14:23:09 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:10 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f" returned: 0 in 0.724s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:10 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f Jul 03 14:23:10 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:11 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-2ce279c2-85c5-4fb8-816c-f611d6002f3f" returned: 0 in 0.616s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] Lock "cinder-quobyte-2ce279c2-85c5-4fb8-816c-f611d6002f3f" released by "delete_volume" :: held 1.398s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:23:11 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] Created reservations ['b0af3e9c-fafe-4c90-b4b1-362563ab7c07', 'eaeaed37-268f-4b47-964e-6cd8ed1b857d', 'b58bfd5d-86f0-446d-b01e-90b58cb78445', '2a04e288-555b-43a4-8892-af6f79c3a5fd'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:23:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:23:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:23:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:23:11 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:23:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:23:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:11 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:23:11 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:11 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.648s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:11 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:23:11 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] Deleted volume successfully. Jul 03 14:23:11 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f5a21010-dcca-4fbf-b742-2cc57686b734 tempest-ProjectMemberTests-789001210 None] Lock "cinder-2ce279c2-85c5-4fb8-816c-f611d6002f3f-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Flow 'volume_create_manager' (24389c68-836a-4ed0-ba8a-72ec147afd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02381c89-4bb3-4530-8971-9a6198c72b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02381c89-4bb3-4530-8971-9a6198c72b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1739566825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94099c6-ee98-4773-aafe-c173417c84fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64aa2814279c4ecc9ef64e7e8fee5660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:23:15Z,use_quota=True,user_id='49ee835edbb64dd19cdc426424412b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd0a46b-a5bc-49c3-942b-ef0862e46224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd0a46b-a5bc-49c3-942b-ef0862e46224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de8bd21-7b30-4a86-9cfc-82852a2cb7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de8bd21-7b30-4a86-9cfc-82852a2cb7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd94099c6-ee98-4773-aafe-c173417c84fd', 'volume_name': 'volume-d94099c6-ee98-4773-aafe-c173417c84fd', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eadc114c-9ec2-4a58-bb02-851d57cc128b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eadc114c-9ec2-4a58-bb02-851d57cc128b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea154081-2cad-466c-90f7-23f9ad6c1f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:15 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Volume d94099c6-ee98-4773-aafe-c173417c84fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d94099c6-ee98-4773-aafe-c173417c84fd', 'volume_size': 1} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1739566825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94099c6-ee98-4773-aafe-c173417c84fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64aa2814279c4ecc9ef64e7e8fee5660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:23:15Z,use_quota=True,user_id='49ee835edbb64dd19cdc426424412b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Creating volume d94099c6-ee98-4773-aafe-c173417c84fd {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:23:15 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:23:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:15 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd 1073741824 Jul 03 14:23:15 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:16 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd 1073741824" returned: 0 in 0.807s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:16 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd Jul 03 14:23:16 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:17 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd" returned: 0 in 0.606s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:23:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:23:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea154081-2cad-466c-90f7-23f9ad6c1f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d94099c6-ee98-4773-aafe-c173417c84fd', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987782ab-c435-46a2-b5ea-7aae861255ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:17 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Volume volume-d94099c6-ee98-4773-aafe-c173417c84fd (d94099c6-ee98-4773-aafe-c173417c84fd): created successfully Jul 03 14:23:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987782ab-c435-46a2-b5ea-7aae861255ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Flow 'volume_create_manager' (24389c68-836a-4ed0-ba8a-72ec147afd32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:23:17 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b0d33849-6c9a-461a-aaf0-3d5ba31252a5 tempest-ProjectReaderTests-1938737409 None] Created volume successfully. Jul 03 14:23:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:23:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:23:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] Creating offline snapshot cc734e83-6507-42d3-9733-9069d5689a6e of volume d94099c6-ee98-4773-aafe-c173417c84fd {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:23:17 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f0c973-969a-4806-a669-f10baed54ee7]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:23:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:17 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd Jul 03 14:23:17 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:18 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd" returned: 0 in 0.761s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:18 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e 1G Jul 03 14:23:18 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:19 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e 1G" returned: 0 in 0.755s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d94099c6-ee98-4773-aafe-c173417c84fd -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:19 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d94099c6-ee98-4773-aafe-c173417c84fd -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e Jul 03 14:23:19 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:19 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d94099c6-ee98-4773-aafe-c173417c84fd -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e" returned: 0 in 0.677s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:19 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e is being set with open permissions: ugo+rw Jul 03 14:23:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:20 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e Jul 03 14:23:20 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:20 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e" returned: 0 in 0.622s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:20 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.info Jul 03 14:23:20 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:21 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.info" returned: 0 in 0.616s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:21 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.info is being set with open permissions: ugo+rw Jul 03 14:23:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:21 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.info Jul 03 14:23:21 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:21 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.info" returned: 0 in 0.608s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.115s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:23:21 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b2ac6d5d-5d38-46ab-9707-2eafcaafc6c5 tempest-ProjectReaderTests-1938737409 None] Create snapshot completed successfully Jul 03 14:23:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-cc734e83-6507-42d3-9733-9069d5689a6e-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:23:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] Lock "cinder-cc734e83-6507-42d3-9733-9069d5689a6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:23:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-quobyte-d94099c6-ee98-4773-aafe-c173417c84fd" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:23:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-d94099c6-ee98-4773-aafe-c173417c84fd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:23:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-quobyte-cc734e83-6507-42d3-9733-9069d5689a6e" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:23:23 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-cc734e83-6507-42d3-9733-9069d5689a6e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:23:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] Deleting offline snapshot cc734e83-6507-42d3-9733-9069d5689a6e of volume d94099c6-ee98-4773-aafe-c173417c84fd {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:23:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] snapshot_file for this snap is: volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:23:23 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cbdd9f-a5a6-47b1-a12d-d65907a66756]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:23:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:23 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e Jul 03 14:23:23 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:23 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e" returned: 0 in 0.724s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:23 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d94099c6-ee98-4773-aafe-c173417c84fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:23:23 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c0dd44-25c2-4d5f-8d0d-4c4418af1382]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:23:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:24 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd Jul 03 14:23:24 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:24 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd" returned: 0 in 0.709s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:24 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e Jul 03 14:23:24 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:25 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e" returned: 0 in 0.724s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:25 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e Jul 03 14:23:25 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:25 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd.cc734e83-6507-42d3-9733-9069d5689a6e" returned: 0 in 0.601s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-cc734e83-6507-42d3-9733-9069d5689a6e" released by "_delete_snapshot" :: held 2.842s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:23:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-d94099c6-ee98-4773-aafe-c173417c84fd" released by "delete_snapshot" :: held 2.861s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:23:26 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] Created reservations ['f3394426-41b4-4d24-8826-1717b2650666', 'ab3494a6-97a7-4aac-ad32-bac0a50a863f', 'ed0db48a-33b8-45e6-9a58-b133b27c3273', '841016e6-bd01-4cd5-bf61-233e6b336a7c'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:23:26 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] Delete snapshot completed successfully. Jul 03 14:23:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-5fa1532e-e376-4ea0-8b43-22074f5fee4e tempest-ProjectReaderTests-1938737409 None] Lock "cinder-cc734e83-6507-42d3-9733-9069d5689a6e-delete_snapshot" released by "delete_snapshot" :: held 2.988s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:23:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-d94099c6-ee98-4773-aafe-c173417c84fd-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:23:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-d94099c6-ee98-4773-aafe-c173417c84fd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:23:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-quobyte-d94099c6-ee98-4773-aafe-c173417c84fd" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:23:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-d94099c6-ee98-4773-aafe-c173417c84fd" acquired by "delete_volume" :: waited 0.014s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:23:26 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed610f54-269b-4556-b1aa-e4b8b99ae35e]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:23:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:26 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd Jul 03 14:23:26 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:27 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd" returned: 0 in 0.713s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:27 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd Jul 03 14:23:27 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:27 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-d94099c6-ee98-4773-aafe-c173417c84fd" returned: 0 in 0.647s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:27 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-d94099c6-ee98-4773-aafe-c173417c84fd" released by "delete_volume" :: held 1.414s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:23:27 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] Created reservations ['b05a445e-27d9-4a8f-b9c6-4aad54ae9919', 'a3ab0723-8156-4b5b-8b77-c2df7dd01433', 'fccb663e-23d2-467e-a12e-7ee50ddd200e', '5b3452e7-144e-4cc3-b249-cc227128e02c'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:23:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:23:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:23:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:23:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:23:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:23:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:27 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:23:27 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:28 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.648s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:28 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:23:28 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] Deleted volume successfully. Jul 03 14:23:28 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3e50f086-d6ee-41a0-9705-c4d9e31da5e9 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-d94099c6-ee98-4773-aafe-c173417c84fd-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:23:28 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:23:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Flow 'volume_create_manager' (5e22e6d4-05b1-431a-83d3-9c06bf9a33f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:23:28 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f62821a-b863-49ba-ba42-6e943b3a9bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f62821a-b863-49ba-ba42-6e943b3a9bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1815260398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eac52b2-f88c-4d9c-b454-13e32bcd452a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64aa2814279c4ecc9ef64e7e8fee5660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:23:29Z,use_quota=True,user_id='49ee835edbb64dd19cdc426424412b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee8cf59-d63e-45f4-a964-3b2f1226931a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee8cf59-d63e-45f4-a964-3b2f1226931a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13ba540-b66f-4abb-95b8-a9a2e853abf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13ba540-b66f-4abb-95b8-a9a2e853abf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eac52b2-f88c-4d9c-b454-13e32bcd452a', 'volume_name': 'volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b23aa9-0c11-44a6-9476-b8541813df91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b23aa9-0c11-44a6-9476-b8541813df91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b03b2bb-d402-4aa4-a7af-0d409ab717c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:29 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Volume 3eac52b2-f88c-4d9c-b454-13e32bcd452a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a', 'volume_size': 1} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1815260398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eac52b2-f88c-4d9c-b454-13e32bcd452a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64aa2814279c4ecc9ef64e7e8fee5660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:23:29Z,use_quota=True,user_id='49ee835edbb64dd19cdc426424412b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Creating volume 3eac52b2-f88c-4d9c-b454-13e32bcd452a {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:23:29 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:29 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a 1073741824 Jul 03 14:23:29 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:29 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a 1073741824" returned: 0 in 0.819s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:29 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a Jul 03 14:23:29 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:30 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a" returned: 0 in 0.671s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:30 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:23:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:23:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b03b2bb-d402-4aa4-a7af-0d409ab717c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b505925-4ab1-4d74-8a7d-fb61fa4c2a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:30 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Volume volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a (3eac52b2-f88c-4d9c-b454-13e32bcd452a): created successfully Jul 03 14:23:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b505925-4ab1-4d74-8a7d-fb61fa4c2a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:30 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Flow 'volume_create_manager' (5e22e6d4-05b1-431a-83d3-9c06bf9a33f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:23:30 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-acc2fccd-ccdb-432b-a004-71c9193c9d7b tempest-ProjectReaderTests-1938737409 None] Created volume successfully. Jul 03 14:23:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:23:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:23:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] Creating offline snapshot a08e2474-a380-4d43-a24d-c90f6729fd46 of volume 3eac52b2-f88c-4d9c-b454-13e32bcd452a {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:23:31 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[530a8f5a-acc8-453f-be4e-f6e6ac5957d0]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:23:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:31 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a Jul 03 14:23:31 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:31 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a" returned: 0 in 0.736s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:31 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46 1G Jul 03 14:23:31 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:32 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46 1G" returned: 0 in 0.761s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:32 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46 Jul 03 14:23:32 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:33 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46" returned: 0 in 0.678s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:33 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46 is being set with open permissions: ugo+rw Jul 03 14:23:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:33 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46 Jul 03 14:23:33 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:34 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46" returned: 0 in 0.609s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:34 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.info Jul 03 14:23:34 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:34 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.info" returned: 0 in 0.625s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:34 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.info is being set with open permissions: ugo+rw Jul 03 14:23:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:34 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.info Jul 03 14:23:34 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:35 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.info" returned: 0 in 0.608s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.103s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:23:35 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-0d9ebdd0-c889-4bd0-817c-8bfcf60bc2d9 tempest-ProjectReaderTests-1938737409 None] Create snapshot completed successfully Jul 03 14:23:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-a08e2474-a380-4d43-a24d-c90f6729fd46-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:23:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-a08e2474-a380-4d43-a24d-c90f6729fd46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:23:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-quobyte-3eac52b2-f88c-4d9c-b454-13e32bcd452a" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:23:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-3eac52b2-f88c-4d9c-b454-13e32bcd452a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:23:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-quobyte-a08e2474-a380-4d43-a24d-c90f6729fd46" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:23:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-a08e2474-a380-4d43-a24d-c90f6729fd46" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:23:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] Deleting offline snapshot a08e2474-a380-4d43-a24d-c90f6729fd46 of volume 3eac52b2-f88c-4d9c-b454-13e32bcd452a {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:23:36 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] snapshot_file for this snap is: volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:23:36 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a1e183-59b8-4aaf-9560-af533855c695]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:23:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:36 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46 Jul 03 14:23:36 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:37 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46" returned: 0 in 0.722s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:37 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:23:37 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f9b966-c1db-4320-9d16-16bde8ecf2fa]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:23:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:37 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a Jul 03 14:23:37 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:37 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a" returned: 0 in 0.737s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:37 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46 Jul 03 14:23:37 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:38 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46" returned: 0 in 0.698s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:38 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46 Jul 03 14:23:38 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:39 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a.a08e2474-a380-4d43-a24d-c90f6729fd46" returned: 0 in 0.607s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-a08e2474-a380-4d43-a24d-c90f6729fd46" released by "_delete_snapshot" :: held 2.846s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:23:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-3eac52b2-f88c-4d9c-b454-13e32bcd452a" released by "delete_snapshot" :: held 2.866s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:23:39 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] Created reservations ['49d1a46b-5381-4942-a094-1b41bc86d1aa', 'beb87c97-05e2-4c44-9c5e-9bb2889864da', 'aa58df25-65f1-48f5-8f90-d57d35ce196e', '3266b208-eadb-476a-91a6-256640cb611d'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:23:39 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] Delete snapshot completed successfully. Jul 03 14:23:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-52b7579e-22a8-432f-aaee-32903ff35ea2 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-a08e2474-a380-4d43-a24d-c90f6729fd46-delete_snapshot" released by "delete_snapshot" :: held 2.994s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:23:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-3eac52b2-f88c-4d9c-b454-13e32bcd452a-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:23:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-3eac52b2-f88c-4d9c-b454-13e32bcd452a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:23:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-quobyte-3eac52b2-f88c-4d9c-b454-13e32bcd452a" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:23:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-3eac52b2-f88c-4d9c-b454-13e32bcd452a" acquired by "delete_volume" :: waited 0.014s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:23:39 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfea73dc-316f-4674-945b-c65dc177674f]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:23:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:39 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a Jul 03 14:23:39 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:40 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a" returned: 0 in 0.810s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:40 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a Jul 03 14:23:40 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:41 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-3eac52b2-f88c-4d9c-b454-13e32bcd452a" returned: 0 in 0.627s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-3eac52b2-f88c-4d9c-b454-13e32bcd452a" released by "delete_volume" :: held 1.494s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:23:41 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] Created reservations ['6447deff-c685-4442-98fe-0c73553313dc', 'f1901dcf-3edc-45a3-9ac2-0d7065de06e6', '82a40b1f-8652-4363-b36a-a25eb7275e6c', 'c3f3c3f2-89a8-4c63-8015-51b95a81b271'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:23:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:23:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:23:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:23:41 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:23:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:23:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:41 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:23:41 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:41 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.639s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:41 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:23:41 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] Deleted volume successfully. Jul 03 14:23:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-da591ec1-945f-4517-b8cd-48d406639dd9 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-3eac52b2-f88c-4d9c-b454-13e32bcd452a-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Flow 'volume_create_manager' (cb8da12c-8299-47c6-b2a8-addd4014b158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0281bc30-26ae-40cc-b7a4-b97c632a6693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0281bc30-26ae-40cc-b7a4-b97c632a6693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-767153931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272cf57a-a927-437a-8537-c2601e0596d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64aa2814279c4ecc9ef64e7e8fee5660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:23:42Z,use_quota=True,user_id='49ee835edbb64dd19cdc426424412b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a35c623d-a7e2-4796-991f-9fbea7493051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a35c623d-a7e2-4796-991f-9fbea7493051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac535f0-68df-4121-b1ed-bfe88079a928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac535f0-68df-4121-b1ed-bfe88079a928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '272cf57a-a927-437a-8537-c2601e0596d2', 'volume_name': 'volume-272cf57a-a927-437a-8537-c2601e0596d2', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7b51f4-4c7a-49a0-8b50-630521f906f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7b51f4-4c7a-49a0-8b50-630521f906f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee17a03-5756-4463-970b-d520ba763d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:42 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Volume 272cf57a-a927-437a-8537-c2601e0596d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-272cf57a-a927-437a-8537-c2601e0596d2', 'volume_size': 1} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-767153931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272cf57a-a927-437a-8537-c2601e0596d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64aa2814279c4ecc9ef64e7e8fee5660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:23:42Z,use_quota=True,user_id='49ee835edbb64dd19cdc426424412b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Creating volume 272cf57a-a927-437a-8537-c2601e0596d2 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:23:42 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:23:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:42 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2 1073741824 Jul 03 14:23:42 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:43 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2 1073741824" returned: 0 in 0.801s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:43 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2 Jul 03 14:23:43 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:43 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2" returned: 0 in 0.700s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:43 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:23:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:23:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee17a03-5756-4463-970b-d520ba763d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-272cf57a-a927-437a-8537-c2601e0596d2', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b80c11b9-d3ee-47a7-aa43-b395d5068073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:23:43 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Volume volume-272cf57a-a927-437a-8537-c2601e0596d2 (272cf57a-a927-437a-8537-c2601e0596d2): created successfully Jul 03 14:23:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b80c11b9-d3ee-47a7-aa43-b395d5068073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:23:43 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Flow 'volume_create_manager' (cb8da12c-8299-47c6-b2a8-addd4014b158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:23:43 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-41e487cc-48d8-4185-9300-0d88575a6464 tempest-ProjectReaderTests-1938737409 None] Created volume successfully. Jul 03 14:23:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:23:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:23:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] Creating offline snapshot 48e826a4-b432-4457-8142-680f2d7f30da of volume 272cf57a-a927-437a-8537-c2601e0596d2 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:23:44 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[179ea123-f270-49e2-8f51-1f7e6f496af4]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:23:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:44 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2 Jul 03 14:23:44 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:45 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2" returned: 0 in 0.807s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2.48e826a4-b432-4457-8142-680f2d7f30da 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:45 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2.48e826a4-b432-4457-8142-680f2d7f30da 1G Jul 03 14:23:45 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:46 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2.48e826a4-b432-4457-8142-680f2d7f30da 1G" returned: 0 in 0.840s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-272cf57a-a927-437a-8537-c2601e0596d2 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2.48e826a4-b432-4457-8142-680f2d7f30da {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:46 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-272cf57a-a927-437a-8537-c2601e0596d2 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2.48e826a4-b432-4457-8142-680f2d7f30da Jul 03 14:23:46 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:46 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-272cf57a-a927-437a-8537-c2601e0596d2 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2.48e826a4-b432-4457-8142-680f2d7f30da" returned: 0 in 0.747s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:46 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2.48e826a4-b432-4457-8142-680f2d7f30da is being set with open permissions: ugo+rw Jul 03 14:23:46 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2.48e826a4-b432-4457-8142-680f2d7f30da {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:46 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2.48e826a4-b432-4457-8142-680f2d7f30da Jul 03 14:23:46 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:47 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2.48e826a4-b432-4457-8142-680f2d7f30da" returned: 0 in 0.667s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:47 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:DELETE=7,cinder:SELECT=60,cinder:UPDATE=77,cinder:INSERT=17 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:23:47 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:INSERT=26,cinder:UPDATE=83,cinder:SELECT=59,cinder:DELETE=6 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:23:47 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:47 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2.info Jul 03 14:23:47 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:48 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2.info" returned: 0 in 0.657s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:48 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2.info is being set with open permissions: ugo+rw Jul 03 14:23:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:48 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2.info Jul 03 14:23:48 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:48 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-272cf57a-a927-437a-8537-c2601e0596d2.info" returned: 0 in 0.657s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:48 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.466s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:23:48 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-777f65be-ce7b-4aed-b636-c948b8d7a42e tempest-ProjectReaderTests-1938737409 None] Create snapshot completed successfully Jul 03 14:23:49 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f14730cc-ee9b-48fc-be6f-9d01fdbb2a31 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-48e826a4-b432-4457-8142-680f2d7f30da-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:23:49 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f14730cc-ee9b-48fc-be6f-9d01fdbb2a31 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-48e826a4-b432-4457-8142-680f2d7f30da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:23:49 devstack cinder-volume[86805]: INFO cinder.message.api [None req-f14730cc-ee9b-48fc-be6f-9d01fdbb2a31 tempest-ProjectReaderTests-1938737409 None] Creating message record for request_id = req-f14730cc-ee9b-48fc-be6f-9d01fdbb2a31 Jul 03 14:23:49 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-f14730cc-ee9b-48fc-be6f-9d01fdbb2a31 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-48e826a4-b432-4457-8142-680f2d7f30da-delete_snapshot" released by "delete_snapshot" :: held 0.032s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server [None req-f14730cc-ee9b-48fc-be6f-9d01fdbb2a31 tempest-ProjectReaderTests-1938737409 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 219, in wrapper Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 14:23:49 devstack cinder-volume[86805]: ERROR oslo_messaging.rpc.server Jul 03 14:23:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:23:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:23:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:23:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:23:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:23:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:23:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:23:58 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:23:58 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:23:59 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Jul 03 14:23:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.656s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:23:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:24:04 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=2,cinder:DELETE=1,cinder:UPDATE=1 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:24:04 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=1,cinder:INSERT=2,cinder:UPDATE=2 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:24:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:24:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:24:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:24:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:24:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:24:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:24:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:24:58 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:24:58 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:24:59 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jul 03 14:24:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.641s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:24:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:25:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:25:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:25:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:25:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:25:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:25:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:25:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:25:58 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:25:58 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:25:59 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Jul 03 14:25:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.614s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:25:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:26:04 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=1 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:26:04 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=1 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:26:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:26:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:26:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:26:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:26:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:26:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:26:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:26:58 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:26:58 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:26:59 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Jul 03 14:26:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.659s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:26:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Flow 'volume_create_manager' (06d0938b-7617-4cbe-9f86-a57530dab2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbf2991-1867-41be-bb38-a92bf7ab3171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbf2991-1867-41be-bb38-a92bf7ab3171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1112570839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6acbecc-a650-4ee5-afc5-27bd6cc29442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64aa2814279c4ecc9ef64e7e8fee5660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:27:06Z,use_quota=True,user_id='49ee835edbb64dd19cdc426424412b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aafb33f-d678-45f4-8271-f3024a2b83cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aafb33f-d678-45f4-8271-f3024a2b83cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c133aca5-3234-46fa-aaa2-ebb823a2e2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c133aca5-3234-46fa-aaa2-ebb823a2e2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6acbecc-a650-4ee5-afc5-27bd6cc29442', 'volume_name': 'volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd2c120-a908-42b9-be0d-9b2d3e61dadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd2c120-a908-42b9-be0d-9b2d3e61dadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d513db-8bed-47c3-b7dc-a7b52ff3146a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:05 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Volume a6acbecc-a650-4ee5-afc5-27bd6cc29442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442', 'volume_size': 1} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1112570839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6acbecc-a650-4ee5-afc5-27bd6cc29442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64aa2814279c4ecc9ef64e7e8fee5660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:27:06Z,use_quota=True,user_id='49ee835edbb64dd19cdc426424412b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Creating volume a6acbecc-a650-4ee5-afc5-27bd6cc29442 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:27:05 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:27:05 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:05 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442 1073741824 Jul 03 14:27:05 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:06 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442 1073741824" returned: 0 in 0.788s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:06 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:06 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442 Jul 03 14:27:06 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:07 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442" returned: 0 in 0.610s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:07 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:27:07 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:27:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d513db-8bed-47c3-b7dc-a7b52ff3146a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9487b1-6e6b-4211-ad0e-2b02d7f6da40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:07 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Volume volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442 (a6acbecc-a650-4ee5-afc5-27bd6cc29442): created successfully Jul 03 14:27:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9487b1-6e6b-4211-ad0e-2b02d7f6da40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:07 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Flow 'volume_create_manager' (06d0938b-7617-4cbe-9f86-a57530dab2e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:27:07 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-0b95ee83-1e6d-46c4-825a-a663e3c096a2 tempest-ProjectReaderTests-1938737409 None] Created volume successfully. Jul 03 14:27:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:27:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:27:08 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] Creating offline snapshot 499bd856-c4d7-4119-b074-203b58c9d79b of volume a6acbecc-a650-4ee5-afc5-27bd6cc29442 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:27:08 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1545e54b-0f0d-49d0-aec1-d14851d012cd]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:27:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:08 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442 Jul 03 14:27:08 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:08 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442" returned: 0 in 0.754s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:08 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:08 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b 1G Jul 03 14:27:08 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:09 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b 1G" returned: 0 in 0.851s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:09 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:09 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b Jul 03 14:27:09 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:10 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b" returned: 0 in 0.727s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:10 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b is being set with open permissions: ugo+rw Jul 03 14:27:10 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:10 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b Jul 03 14:27:10 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:11 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b" returned: 0 in 0.634s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:11 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.info Jul 03 14:27:11 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:11 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.info" returned: 0 in 0.683s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:11 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.info is being set with open permissions: ugo+rw Jul 03 14:27:11 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:11 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.info Jul 03 14:27:11 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:12 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.info" returned: 0 in 0.628s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:12 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.359s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:27:12 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-451d541d-3359-484e-a549-ed68fc6ca6a5 tempest-ProjectReaderTests-1938737409 None] Create snapshot completed successfully Jul 03 14:27:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-499bd856-c4d7-4119-b074-203b58c9d79b-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:27:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-499bd856-c4d7-4119-b074-203b58c9d79b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:27:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-quobyte-a6acbecc-a650-4ee5-afc5-27bd6cc29442" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:27:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-a6acbecc-a650-4ee5-afc5-27bd6cc29442" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:27:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-quobyte-499bd856-c4d7-4119-b074-203b58c9d79b" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:27:13 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-499bd856-c4d7-4119-b074-203b58c9d79b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:27:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] Deleting offline snapshot 499bd856-c4d7-4119-b074-203b58c9d79b of volume a6acbecc-a650-4ee5-afc5-27bd6cc29442 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:27:13 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] snapshot_file for this snap is: volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:27:13 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cc9b5b-ce0c-49e1-9485-d1c0518cb5c9]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:27:13 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:13 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b Jul 03 14:27:13 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:14 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b" returned: 0 in 0.725s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:14 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:27:14 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0ab324-1fee-4d6f-b5cc-b856a89aab71]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:27:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:14 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442 Jul 03 14:27:14 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:14 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442" returned: 0 in 0.726s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:14 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:14 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b Jul 03 14:27:14 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:15 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b" returned: 0 in 0.725s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:15 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:15 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b Jul 03 14:27:15 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:16 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442.499bd856-c4d7-4119-b074-203b58c9d79b" returned: 0 in 0.652s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-499bd856-c4d7-4119-b074-203b58c9d79b" released by "_delete_snapshot" :: held 2.913s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:27:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-a6acbecc-a650-4ee5-afc5-27bd6cc29442" released by "delete_snapshot" :: held 2.937s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:27:16 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] Created reservations ['eff4234c-dae1-4113-8f5f-965f3419ce55', '98b18ad8-e369-4ab4-a863-03dc75cb761b', '973819d7-8e82-46aa-a84a-1a5d9d41297e', '2d6b6164-8407-420e-b3cd-aa618610c9b4'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:27:16 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] Delete snapshot completed successfully. Jul 03 14:27:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-3bf0bd36-c8dc-4596-9b09-094be6ff8c90 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-499bd856-c4d7-4119-b074-203b58c9d79b-delete_snapshot" released by "delete_snapshot" :: held 3.067s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:27:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-a6acbecc-a650-4ee5-afc5-27bd6cc29442-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:27:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-a6acbecc-a650-4ee5-afc5-27bd6cc29442-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:27:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-quobyte-a6acbecc-a650-4ee5-afc5-27bd6cc29442" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:27:16 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-a6acbecc-a650-4ee5-afc5-27bd6cc29442" acquired by "delete_volume" :: waited 0.013s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:27:16 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cead991-47f0-4e81-9474-7d1cb3a70dcf]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:27:16 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:16 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442 Jul 03 14:27:16 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:17 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442" returned: 0 in 0.762s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:17 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442 Jul 03 14:27:17 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:18 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-a6acbecc-a650-4ee5-afc5-27bd6cc29442" returned: 0 in 0.657s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-a6acbecc-a650-4ee5-afc5-27bd6cc29442" released by "delete_volume" :: held 1.472s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:27:18 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] Created reservations ['2b98f026-95c0-41c5-87f9-bd613107f45d', 'e403f401-c45b-4574-bb80-a3049d27718c', 'e4e9159d-c0f6-4b57-bc14-fff67996bd97', 'adea4ca3-5cbe-4b1f-8e33-ff0fa5c69338'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:27:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:27:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:27:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:27:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:27:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:27:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:18 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:27:18 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:18 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.658s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:18 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:27:18 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] Deleted volume successfully. Jul 03 14:27:18 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-fc974083-f4b3-4242-a224-bdd689158c51 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-a6acbecc-a650-4ee5-afc5-27bd6cc29442-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Flow 'volume_create_manager' (d5cd2c3c-f163-4e31-b0cc-0ce38b4b7b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c34b0512-b3be-4959-9302-577b9ed3cfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c34b0512-b3be-4959-9302-577b9ed3cfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1083396642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64aa2814279c4ecc9ef64e7e8fee5660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:27:19Z,use_quota=True,user_id='49ee835edbb64dd19cdc426424412b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9f5f5c-cbda-4f66-a702-d0a9f3b2e3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9f5f5c-cbda-4f66-a702-d0a9f3b2e3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0962842-ef7e-434e-b4ba-a89bbd018b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0962842-ef7e-434e-b4ba-a89bbd018b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e', 'volume_name': 'volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb87c566-faa0-4afa-a942-ee7c0a03e4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb87c566-faa0-4afa-a942-ee7c0a03e4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4222f50-4763-44ea-8486-b27bb0be806a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:19 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Volume ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e', 'volume_size': 1} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1083396642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64aa2814279c4ecc9ef64e7e8fee5660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:27:19Z,use_quota=True,user_id='49ee835edbb64dd19cdc426424412b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Creating volume ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:27:19 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:27:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:19 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e 1073741824 Jul 03 14:27:19 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:20 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e 1073741824" returned: 0 in 0.791s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:20 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e Jul 03 14:27:20 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:20 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e" returned: 0 in 0.680s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:20 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:27:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:27:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4222f50-4763-44ea-8486-b27bb0be806a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e84fc0-9f90-4846-a1f3-c606fc6ffa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:20 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Volume volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e (ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e): created successfully Jul 03 14:27:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e84fc0-9f90-4846-a1f3-c606fc6ffa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:20 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Flow 'volume_create_manager' (d5cd2c3c-f163-4e31-b0cc-0ce38b4b7b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:27:20 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ab9cadd3-0e8c-4c83-8e40-4747dab6c89a tempest-ProjectReaderTests-1938737409 None] Created volume successfully. Jul 03 14:27:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:27:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:27:21 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] Creating offline snapshot 30991fe1-82c3-4509-a08d-9b2ee5cc6540 of volume ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:27:21 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b9fd4c-7d8a-4da2-8c94-01bc98ce0741]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:27:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:21 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e Jul 03 14:27:21 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:22 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e" returned: 0 in 0.744s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:22 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540 1G Jul 03 14:27:22 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:22 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540 1G" returned: 0 in 0.770s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:22 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540 Jul 03 14:27:22 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:23 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540" returned: 0 in 0.689s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:23 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540 is being set with open permissions: ugo+rw Jul 03 14:27:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:23 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540 Jul 03 14:27:23 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:24 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540" returned: 0 in 0.629s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:24 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.info Jul 03 14:27:24 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:24 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.info" returned: 0 in 0.646s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:24 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.info is being set with open permissions: ugo+rw Jul 03 14:27:24 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:24 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.info Jul 03 14:27:24 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:25 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.info" returned: 0 in 0.631s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.186s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:27:25 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-6f4bf505-e059-4aab-aad8-8d0726f05aed tempest-ProjectReaderTests-1938737409 None] Create snapshot completed successfully Jul 03 14:27:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-30991fe1-82c3-4509-a08d-9b2ee5cc6540-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:27:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-30991fe1-82c3-4509-a08d-9b2ee5cc6540-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:27:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-quobyte-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:27:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:27:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-quobyte-30991fe1-82c3-4509-a08d-9b2ee5cc6540" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:27:26 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-30991fe1-82c3-4509-a08d-9b2ee5cc6540" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:27:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] Deleting offline snapshot 30991fe1-82c3-4509-a08d-9b2ee5cc6540 of volume ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:27:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] snapshot_file for this snap is: volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:27:26 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57c54f6-3e9d-405f-8777-92a3fbe6fbb5]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:27:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:26 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540 Jul 03 14:27:26 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:27 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540" returned: 0 in 0.729s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:27 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:27:27 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccb84d3-f1f1-476c-bcac-065f182b5e25]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:27:27 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:27 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e Jul 03 14:27:27 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:28 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e" returned: 0 in 0.752s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:28 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540 Jul 03 14:27:28 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:28 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540" returned: 0 in 0.687s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:28 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:28 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540 Jul 03 14:27:28 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:29 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e.30991fe1-82c3-4509-a08d-9b2ee5cc6540" returned: 0 in 0.631s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-30991fe1-82c3-4509-a08d-9b2ee5cc6540" released by "_delete_snapshot" :: held 2.884s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:27:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e" released by "delete_snapshot" :: held 2.908s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:27:29 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] Created reservations ['8f570cfe-baea-495b-8b7c-119a0cc32656', 'ef7ee513-2f44-44e3-8039-d7bff92272a1', '1500b840-8bd7-4b18-9a48-2c4de9df6520', '0acc50f2-9570-4819-a89c-616f65252c10'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:27:29 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] Delete snapshot completed successfully. Jul 03 14:27:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-838bfada-a9ac-46c3-8062-a3c20f37a791 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-30991fe1-82c3-4509-a08d-9b2ee5cc6540-delete_snapshot" released by "delete_snapshot" :: held 3.037s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:27:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:27:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] Lock "cinder-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:27:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-quobyte-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:27:29 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:27:29 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd5f849-6e16-474a-b804-48068a4bb05b]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:27:29 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:29 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e Jul 03 14:27:29 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:30 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e" returned: 0 in 0.718s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:30 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:30 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e Jul 03 14:27:30 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:31 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e" returned: 0 in 0.629s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e" released by "delete_volume" :: held 1.398s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:27:31 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] Created reservations ['b150f2a1-523a-41c4-9e1e-ea5f8d882b32', 'ed27ff01-1cc0-4b46-bbe3-43a10d895368', '2eefddc2-f5bc-43bc-abe7-16ecf0c4708c', 'c4dc60cc-590e-4435-955b-63079442d820'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:27:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:27:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:27:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:27:31 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:27:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:27:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:31 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:27:31 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:31 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.606s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:31 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:27:31 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] Deleted volume successfully. Jul 03 14:27:31 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-6af4defe-6fa4-4c6d-a452-52ea4b6297ba tempest-ProjectReaderTests-1938737409 None] Lock "cinder-ac917f72-47bc-444a-9ae7-c5d0f9f7ef7e-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Flow 'volume_create_manager' (8f3abbe2-6787-4b17-83ff-cbd52b3ab1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d10a19b-8f44-428c-afea-0c3202e3db2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d10a19b-8f44-428c-afea-0c3202e3db2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-248813592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713eae77-e8f8-40b4-b88b-7a1d41cb1250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64aa2814279c4ecc9ef64e7e8fee5660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:27:32Z,use_quota=True,user_id='49ee835edbb64dd19cdc426424412b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8986d0a-5257-47ee-ad03-573811175166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8986d0a-5257-47ee-ad03-573811175166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89341a0-e546-44c6-abf5-10e6a31911a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89341a0-e546-44c6-abf5-10e6a31911a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '713eae77-e8f8-40b4-b88b-7a1d41cb1250', 'volume_name': 'volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87ce877-a4ca-409d-8097-339770d25af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87ce877-a4ca-409d-8097-339770d25af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a6fe73-fc66-41f4-b80f-438eaf9f20ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:32 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Volume 713eae77-e8f8-40b4-b88b-7a1d41cb1250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250', 'volume_size': 1} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-248813592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713eae77-e8f8-40b4-b88b-7a1d41cb1250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64aa2814279c4ecc9ef64e7e8fee5660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:27:32Z,use_quota=True,user_id='49ee835edbb64dd19cdc426424412b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Creating volume 713eae77-e8f8-40b4-b88b-7a1d41cb1250 {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:27:32 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:27:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:32 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250 1073741824 Jul 03 14:27:32 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:33 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250 1073741824" returned: 0 in 0.832s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:33 devstack sudo[108476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250 Jul 03 14:27:33 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:34 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250" returned: 0 in 0.614s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:27:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:27:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a6fe73-fc66-41f4-b80f-438eaf9f20ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c5c2e8-5f6e-4167-aa31-1919c5b61124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:27:34 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Volume volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250 (713eae77-e8f8-40b4-b88b-7a1d41cb1250): created successfully Jul 03 14:27:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c5c2e8-5f6e-4167-aa31-1919c5b61124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:27:34 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Flow 'volume_create_manager' (8f3abbe2-6787-4b17-83ff-cbd52b3ab1fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:27:34 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-c9cc0009-f807-44d6-b753-16bd72cbaa3a tempest-ProjectReaderTests-1938737409 None] Created volume successfully. Jul 03 14:27:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:27:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:27:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] Creating offline snapshot 6ade54cf-ea14-4f3d-a694-4c569a317b57 of volume 713eae77-e8f8-40b4-b88b-7a1d41cb1250 {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:27:34 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8e142e-169d-47ef-9921-aa5bc6cace87]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:27:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:34 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250 Jul 03 14:27:34 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:35 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250" returned: 0 in 0.720s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:35 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57 1G Jul 03 14:27:35 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:36 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57 1G" returned: 0 in 0.757s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:36 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57 Jul 03 14:27:36 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:36 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250 -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57" returned: 0 in 0.646s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:36 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57 is being set with open permissions: ugo+rw Jul 03 14:27:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:36 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57 Jul 03 14:27:36 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:37 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57" returned: 0 in 0.632s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:37 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.info Jul 03 14:27:37 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:38 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.info" returned: 0 in 0.654s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:38 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.info is being set with open permissions: ugo+rw Jul 03 14:27:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:38 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.info Jul 03 14:27:38 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:38 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.info" returned: 0 in 0.608s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.112s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:27:38 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-8ffee17b-d3dc-497b-a02e-07aa7d46a0e6 tempest-ProjectReaderTests-1938737409 None] Create snapshot completed successfully Jul 03 14:27:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-6ade54cf-ea14-4f3d-a694-4c569a317b57-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:27:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-6ade54cf-ea14-4f3d-a694-4c569a317b57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:27:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-quobyte-713eae77-e8f8-40b4-b88b-7a1d41cb1250" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:27:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-713eae77-e8f8-40b4-b88b-7a1d41cb1250" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:27:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-quobyte-6ade54cf-ea14-4f3d-a694-4c569a317b57" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:27:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-6ade54cf-ea14-4f3d-a694-4c569a317b57" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:27:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] Deleting offline snapshot 6ade54cf-ea14-4f3d-a694-4c569a317b57 of volume 713eae77-e8f8-40b4-b88b-7a1d41cb1250 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:27:39 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] snapshot_file for this snap is: volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57 {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:27:39 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2f82cb-7b47-43c8-8d7d-9d02723973ee]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:27:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:39 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57 Jul 03 14:27:40 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:40 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57" returned: 0 in 0.738s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:27:40 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c3e97c-cdb1-42f8-8e84-2fe1838d2890]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:27:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:40 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250 Jul 03 14:27:40 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:41 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250" returned: 0 in 0.779s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:41 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57 Jul 03 14:27:41 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:42 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57" returned: 0 in 0.712s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:42 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57 Jul 03 14:27:42 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:42 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:42 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250.6ade54cf-ea14-4f3d-a694-4c569a317b57" returned: 0 in 0.654s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-6ade54cf-ea14-4f3d-a694-4c569a317b57" released by "_delete_snapshot" :: held 2.970s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:27:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-713eae77-e8f8-40b4-b88b-7a1d41cb1250" released by "delete_snapshot" :: held 2.991s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:27:42 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] Created reservations ['3d189117-3e33-45d7-ba32-87ca6982cee0', 'f6575eb7-0d7c-48e6-8d40-9f8eba69f8c0', 'e3eed15d-4093-4b81-bdbe-6f27cff8e8c6', '7a391669-ab47-4599-8834-7e9732c92a23'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:27:42 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] Delete snapshot completed successfully. Jul 03 14:27:42 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2d0b0048-3453-40b5-976a-ea3853d324e5 tempest-ProjectReaderTests-1938737409 None] Lock "cinder-6ade54cf-ea14-4f3d-a694-4c569a317b57-delete_snapshot" released by "delete_snapshot" :: held 3.127s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:27:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-713eae77-e8f8-40b4-b88b-7a1d41cb1250-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:27:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] Lock "cinder-713eae77-e8f8-40b4-b88b-7a1d41cb1250-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:27:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] Acquiring lock "cinder-quobyte-713eae77-e8f8-40b4-b88b-7a1d41cb1250" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:27:43 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-713eae77-e8f8-40b4-b88b-7a1d41cb1250" acquired by "delete_volume" :: waited 0.013s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:27:43 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7a36ab-19d2-4812-bf77-d5ac50890e8d]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:27:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:43 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250 Jul 03 14:27:43 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:43 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250" returned: 0 in 0.728s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:43 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:43 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250 Jul 03 14:27:43 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:44 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-713eae77-e8f8-40b4-b88b-7a1d41cb1250" returned: 0 in 0.648s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:44 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] Lock "cinder-quobyte-713eae77-e8f8-40b4-b88b-7a1d41cb1250" released by "delete_volume" :: held 1.433s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:27:44 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] Created reservations ['f6b81c55-8a16-4fc5-ad81-d83d23141bf0', '5740ff59-f3a0-4934-9593-5130a2d0118d', 'fc6c12b0-378a-4a81-896a-1ba8657edf7c', '6c3a2242-a714-4c21-84b9-7b5a42823ee5'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:27:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:27:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:27:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:27:44 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:27:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:27:44 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:44 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:27:44 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:45 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:45 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.643s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:45 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:27:45 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] Deleted volume successfully. Jul 03 14:27:45 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-03c8397c-8138-4107-b42e-83955309e91f tempest-ProjectReaderTests-1938737409 None] Lock "cinder-713eae77-e8f8-40b4-b88b-7a1d41cb1250-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:27:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:27:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:27:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:27:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:27:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:27:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:27:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:27:58 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:27:58 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:27:59 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Jul 03 14:27:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.670s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:27:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:28:04 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=38,cinder:INSERT=14,cinder:UPDATE=59,cinder:DELETE=4 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:28:04 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=50,cinder:SELECT=47,cinder:INSERT=16,cinder:DELETE=5 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:28:16 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:28:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Flow 'volume_create_manager' (b54296ab-f3d2-4c0d-803c-08a098cd8619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:28:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2623a00-760c-4416-969f-42a456a4479e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:28:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2623a00-760c-4416-969f-42a456a4479e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-645312328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dfcd9e2-8145-469b-a24a-17ed9c0c433b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb2bcca2bb4446c85f23b102d2cef23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:28:17Z,use_quota=True,user_id='95fa2dd1c7594590a4e8613d6e366072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:28:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb31aff-10ad-4755-9c5f-00a4ac5c066c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:28:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb31aff-10ad-4755-9c5f-00a4ac5c066c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:28:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fe7710-3944-439a-964f-d5693cdf1caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:28:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fe7710-3944-439a-964f-d5693cdf1caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dfcd9e2-8145-469b-a24a-17ed9c0c433b', 'volume_name': 'volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:28:16 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f94095-65a2-4326-bb6b-23ea3ec4a628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:28:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f94095-65a2-4326-bb6b-23ea3ec4a628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:28:17 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c5267f-b720-4a6c-9dee-42e04ee8b0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:28:17 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Volume 5dfcd9e2-8145-469b-a24a-17ed9c0c433b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b', 'volume_size': 1} Jul 03 14:28:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:28:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:28:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-645312328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dfcd9e2-8145-469b-a24a-17ed9c0c433b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb2bcca2bb4446c85f23b102d2cef23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:28:17Z,use_quota=True,user_id='95fa2dd1c7594590a4e8613d6e366072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)}" {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:28:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Creating volume 5dfcd9e2-8145-469b-a24a-17ed9c0c433b {{(pid=86805) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:28:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:28:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:28:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:28:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:28:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:28:17 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:28:17 devstack cinder-volume[86805]: INFO cinder.volume.drivers.remotefs [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] casted to osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 Jul 03 14:28:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b 1073741824 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:17 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b 1073741824 Jul 03 14:28:17 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:17 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b 1073741824" returned: 0 in 0.863s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:17 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:17 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b Jul 03 14:28:17 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:18 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b" returned: 0 in 0.705s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:18 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'} {{(pid=86805) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:28:18 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:28:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c5267f-b720-4a6c-9dee-42e04ee8b0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b', 'volume_size': 1}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:28:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b67a5e9-e52a-49d0-afc5-fa776805e3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:28:18 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Volume volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b (5dfcd9e2-8145-469b-a24a-17ed9c0c433b): created successfully Jul 03 14:28:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b67a5e9-e52a-49d0-afc5-fa776805e3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:28:18 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Flow 'volume_create_manager' (b54296ab-f3d2-4c0d-803c-08a098cd8619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:28:18 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-ea24b72e-9ab6-4e1b-8e7a-f9de2c0735d7 tempest-SnapshotDependencyTests-1565446498 None] Created volume successfully. Jul 03 14:28:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:28:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:28:19 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] Creating offline snapshot 0b065326-700d-4e7d-9076-5446f9d3854b of volume 5dfcd9e2-8145-469b-a24a-17ed9c0c433b {{(pid=86805) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:28:19 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[4435d0c1-1492-47ec-b43a-ac011be79a3a]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:28:19 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:19 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b Jul 03 14:28:19 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:20 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b" returned: 0 in 0.747s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b 1G {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:20 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b 1G Jul 03 14:28:20 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:20 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b 1G" returned: 0 in 0.835s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:20 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:20 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b Jul 03 14:28:20 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:21 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b -F qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b" returned: 0 in 0.735s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:21 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b is being set with open permissions: ugo+rw Jul 03 14:28:21 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:21 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b Jul 03 14:28:21 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:22 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b" returned: 0 in 0.672s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:22 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.info Jul 03 14:28:22 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:22 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.info" returned: 0 in 0.661s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:22 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.info is being set with open permissions: ugo+rw Jul 03 14:28:22 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.info {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:23 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.info Jul 03 14:28:23 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:23 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.info" returned: 0 in 0.642s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:23 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.389s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:28:23 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-3a63fdfe-2319-4c2e-b017-94cd7acfce17 tempest-SnapshotDependencyTests-1565446498 None] Create snapshot completed successfully Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.flows.manager.create_volume [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86805) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Flow 'volume_create_manager' (59d2cf62-69ce-44a4-af5f-aa2b02c3eef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8144e2-5ae4-4807-a506-608a4937fd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8144e2-5ae4-4807-a506-608a4937fd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6333a183-58eb-4d50-a7e3-36756c336c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb2bcca2bb4446c85f23b102d2cef23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0b065326-700d-4e7d-9076-5446f9d3854b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:28:25Z,use_quota=True,user_id='95fa2dd1c7594590a4e8613d6e366072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e43d2e-a3ff-43c0-bc85-0ac91172236a),volume_type_id=59e43d2e-a3ff-43c0-bc85-0ac91172236a)' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc10a33-7bd7-4953-87ad-917c7843a7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc10a33-7bd7-4953-87ad-917c7843a7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46518655-c7af-4c5f-b8aa-b49551ed5d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46518655-c7af-4c5f-b8aa-b49551ed5d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6333a183-58eb-4d50-a7e3-36756c336c79', 'volume_name': 'volume-6333a183-58eb-4d50-a7e3-36756c336c79', 'volume_size': 1, 'snapshot_id': '0b065326-700d-4e7d-9076-5446f9d3854b'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e572becd-dca9-483f-8472-75c56d0518d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e572becd-dca9-483f-8472-75c56d0518d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846f2aba-385c-45b0-9a4a-a65b2cc8bbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:28:25 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Volume 6333a183-58eb-4d50-a7e3-36756c336c79: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6333a183-58eb-4d50-a7e3-36756c336c79', 'volume_size': 1, 'snapshot_id': '0b065326-700d-4e7d-9076-5446f9d3854b'} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Acquiring lock "cinder-quobyte-0b065326-700d-4e7d-9076-5446f9d3854b-6333a183-58eb-4d50-a7e3-36756c336c79" by "_create_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-quobyte-0b065326-700d-4e7d-9076-5446f9d3854b-6333a183-58eb-4d50-a7e3-36756c336c79" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Creating volume 6333a183-58eb-4d50-a7e3-36756c336c79 from snapshot 0b065326-700d-4e7d-9076-5446f9d3854b {{(pid=86805) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Selected osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28 as target Quobyte volume. {{(pid=86805) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Acquiring lock "cinder-quobyte-6333a183-58eb-4d50-a7e3-36756c336c79" by "_copy_volume_from_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-quobyte-6333a183-58eb-4d50-a7e3-36756c336c79" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] snapshot: 0b065326-700d-4e7d-9076-5446f9d3854b, volume: 6333a183-58eb-4d50-a7e3-36756c336c79, {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b4603d-a0a6-4821-a3c1-c283e21f7f40]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:28:25 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:25 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b Jul 03 14:28:25 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:26 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b" returned: 0 in 0.798s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:28:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] will copy from snapshot at /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 14:28:26 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Creating direct copy from snapshot {{(pid=86805) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 14:28:26 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d45fed-b7b0-4735-b112-881654384043]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:28:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:26 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b Jul 03 14:28:26 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:26 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b" returned: 0 in 0.735s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:26 devstack cinder-volume[86805]: DEBUG cinder.utils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Path /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6333a183-58eb-4d50-a7e3-36756c336c79 not found in is_blk_device check {{(pid=86805) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 14:28:26 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6333a183-58eb-4d50-a7e3-36756c336c79 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:26 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6333a183-58eb-4d50-a7e3-36756c336c79 Jul 03 14:28:26 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:31 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6333a183-58eb-4d50-a7e3-36756c336c79" returned: 0 in 4.432s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:31 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c274f6-1a43-42f7-9026-2c39b8b6c8c4]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:28:31 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:31 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b Jul 03 14:28:31 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:32 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b" returned: 0 in 0.901s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:32 devstack cinder-volume[86805]: DEBUG cinder.image.image_utils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Image conversion details: src /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b, size 1024.00 MB, duration 4.43 sec, destination /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6333a183-58eb-4d50-a7e3-36756c336c79 {{(pid=86805) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:28:32 devstack cinder-volume[86805]: INFO cinder.image.image_utils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Converted 1024.00 MB image at 231.00 MB/s Jul 03 14:28:32 devstack cinder-volume[86805]: WARNING cinder.volume.drivers.remotefs [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6333a183-58eb-4d50-a7e3-36756c336c79 is being set with open permissions: ugo+rw Jul 03 14:28:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6333a183-58eb-4d50-a7e3-36756c336c79 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:32 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6333a183-58eb-4d50-a7e3-36756c336c79 Jul 03 14:28:32 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:32 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6333a183-58eb-4d50-a7e3-36756c336c79" returned: 0 in 0.631s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-quobyte-6333a183-58eb-4d50-a7e3-36756c336c79" released by "_copy_volume_from_snapshot" :: held 7.591s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:28:32 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-quobyte-0b065326-700d-4e7d-9076-5446f9d3854b-6333a183-58eb-4d50-a7e3-36756c336c79" released by "_create_volume_from_snapshot" :: held 7.618s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:28:32 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.633s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:28:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846f2aba-385c-45b0-9a4a-a65b2cc8bbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6333a183-58eb-4d50-a7e3-36756c336c79', 'volume_size': 1, 'snapshot_id': '0b065326-700d-4e7d-9076-5446f9d3854b'}' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:28:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c750429-8221-4855-83aa-935744726086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:28:32 devstack cinder-volume[86805]: INFO cinder.volume.flows.manager.create_volume [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Volume volume-6333a183-58eb-4d50-a7e3-36756c336c79 (6333a183-58eb-4d50-a7e3-36756c336c79): created successfully Jul 03 14:28:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c750429-8221-4855-83aa-935744726086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86805) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:28:32 devstack cinder-volume[86805]: DEBUG cinder.volume.manager [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Flow 'volume_create_manager' (59d2cf62-69ce-44a4-af5f-aa2b02c3eef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86805) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:28:32 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-2418ae8b-7d46-44db-b549-7bc752de12b9 tempest-SnapshotDependencyTests-1565446498 None] Created volume successfully. Jul 03 14:28:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] Acquiring lock "cinder-0b065326-700d-4e7d-9076-5446f9d3854b-delete_snapshot" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:28:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-0b065326-700d-4e7d-9076-5446f9d3854b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:28:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] Acquiring lock "cinder-quobyte-5dfcd9e2-8145-469b-a24a-17ed9c0c433b" by "delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:28:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-quobyte-5dfcd9e2-8145-469b-a24a-17ed9c0c433b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:28:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] Acquiring lock "cinder-quobyte-0b065326-700d-4e7d-9076-5446f9d3854b" by "_delete_snapshot" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:28:33 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-quobyte-0b065326-700d-4e7d-9076-5446f9d3854b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:28:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] Deleting offline snapshot 0b065326-700d-4e7d-9076-5446f9d3854b of volume 5dfcd9e2-8145-469b-a24a-17ed9c0c433b {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:28:33 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] snapshot_file for this snap is: volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b {{(pid=86805) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:28:33 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1e7b51-d53c-4795-aa34-995b0a4d3bbd]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:28:33 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:33 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b Jul 03 14:28:33 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:34 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b" returned: 0 in 0.717s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:34 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.remotefs [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86805) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:28:34 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[2143e881-6427-4833-a04d-f8731346a8ff]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:28:34 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:34 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b Jul 03 14:28:34 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:35 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b" returned: 0 in 0.719s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:35 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:35 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b Jul 03 14:28:35 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:36 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b" returned: 0 in 0.708s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:36 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b Jul 03 14:28:36 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:36 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:36 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b.0b065326-700d-4e7d-9076-5446f9d3854b" returned: 0 in 0.618s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-quobyte-0b065326-700d-4e7d-9076-5446f9d3854b" released by "_delete_snapshot" :: held 2.853s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:28:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-quobyte-5dfcd9e2-8145-469b-a24a-17ed9c0c433b" released by "delete_snapshot" :: held 2.873s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:28:36 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] Created reservations ['9813c39f-bf92-4fd4-93f4-09153b5eefd5', '6f0d339b-5c50-45c5-ba28-5b4e4c74d080', 'be508d61-0968-42ba-a8c0-f7fa0e3c4a40', '15feb297-639d-4258-bd0a-346a58a98b04'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:28:36 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] Delete snapshot completed successfully. Jul 03 14:28:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-96a7873b-97f4-4696-9d53-98e6db0feae8 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-0b065326-700d-4e7d-9076-5446f9d3854b-delete_snapshot" released by "delete_snapshot" :: held 3.004s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:28:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] Acquiring lock "cinder-5dfcd9e2-8145-469b-a24a-17ed9c0c433b-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:28:36 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-5dfcd9e2-8145-469b-a24a-17ed9c0c433b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:28:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] Acquiring lock "cinder-quobyte-5dfcd9e2-8145-469b-a24a-17ed9c0c433b" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:28:37 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-quobyte-5dfcd9e2-8145-469b-a24a-17ed9c0c433b" acquired by "delete_volume" :: waited 0.016s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:28:37 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[1124c9b2-c332-4353-ab9e-60e99ddb22c4]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:28:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:37 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b Jul 03 14:28:37 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:37 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b" returned: 0 in 0.754s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:37 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:37 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b Jul 03 14:28:37 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:38 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-5dfcd9e2-8145-469b-a24a-17ed9c0c433b" returned: 0 in 0.643s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:38 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-quobyte-5dfcd9e2-8145-469b-a24a-17ed9c0c433b" released by "delete_volume" :: held 1.456s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:28:38 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] Created reservations ['0e2e5f56-54bf-481a-891e-395ae3f0be0d', '072a851b-94d4-4a49-aa6d-6b3aece4360d', '58a5d412-4d35-4187-b842-84061c9c5a2d', '94116ce5-ca16-4244-9bf9-b6b283764e74'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:28:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:28:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:28:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:28:38 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:28:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:28:38 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:38 devstack sudo[108681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:28:38 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] Acquiring lock "cinder-6333a183-58eb-4d50-a7e3-36756c336c79-delete_volume" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:28:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-6333a183-58eb-4d50-a7e3-36756c336c79-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:28:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] Acquiring lock "cinder-quobyte-6333a183-58eb-4d50-a7e3-36756c336c79" by "delete_volume" {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:28:39 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-quobyte-6333a183-58eb-4d50-a7e3-36756c336c79" acquired by "delete_volume" :: waited 0.017s {{(pid=86805) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:28:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.711s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:39 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:28:39 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] Deleted volume successfully. Jul 03 14:28:39 devstack cinder-volume[86805]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1b414a-01d2-4277-b7f0-5fadb55b4d68]: (4, 'qcow2') {{(pid=87884) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:28:39 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6333a183-58eb-4d50-a7e3-36756c336c79 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:39 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b7b81f33-70f4-4caf-a9a7-38a4fb741c17 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-5dfcd9e2-8145-469b-a24a-17ed9c0c433b-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:28:39 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6333a183-58eb-4d50-a7e3-36756c336c79 Jul 03 14:28:39 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:40 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6333a183-58eb-4d50-a7e3-36756c336c79" returned: 0 in 0.736s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6333a183-58eb-4d50-a7e3-36756c336c79 {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:40 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6333a183-58eb-4d50-a7e3-36756c336c79 Jul 03 14:28:40 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:40 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce/volume-6333a183-58eb-4d50-a7e3-36756c336c79" returned: 0 in 0.672s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:40 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-quobyte-6333a183-58eb-4d50-a7e3-36756c336c79" released by "delete_volume" :: held 1.452s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:28:40 devstack cinder-volume[86805]: DEBUG cinder.quota [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] Created reservations ['df529a18-84ff-42e8-b8d0-7d1805ecc0e1', '3671b924-5504-4a76-902d-b22b28240fc8', 'e6242a9c-7cbd-4b54-bac1-9a0a3f7851d1', '6237fd4c-7542-4217-8e59-a29d09f43820'] {{(pid=86805) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:28:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:28:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:28:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:28:40 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:28:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:28:40 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:40 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:28:40 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:41 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:41 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.627s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:41 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:28:41 devstack cinder-volume[86805]: INFO cinder.volume.manager [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] Deleted volume successfully. Jul 03 14:28:41 devstack cinder-volume[86805]: DEBUG cinder.coordination [None req-b924d032-2c6c-402e-acb6-a414f3223814 tempest-SnapshotDependencyTests-1565446498 None] Lock "cinder-6333a183-58eb-4d50-a7e3-36756c336c79-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=86805) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:28:50 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:UPDATE=27,cinder:SELECT=24,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:28:51 devstack cinder-volume[86805]: DEBUG dbcounter [-] [86805] Writing DB stats cinder:SELECT=23,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=8 {{(pid=86805) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:28:58 devstack cinder-volume[86805]: DEBUG oslo_service.periodic_task [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86805) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:28:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:28:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:28:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28': None} {{(pid=86805) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:28:58 devstack cinder-volume[86805]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9cd4efa0-e1af-4181-a277-497466994b28'] {{(pid=86805) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:28:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.lockutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86805) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:28:58 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:28:58 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce Jul 03 14:28:58 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:28:59 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Jul 03 14:28:59 devstack cinder-volume[86805]: DEBUG oslo_concurrency.processutils [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/45bcc90e20d7560b507a87542cd2f5ce" returned: 0 in 0.626s {{(pid=86805) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:28:59 devstack cinder-volume[86805]: DEBUG cinder.manager [None req-9e518b8b-8ded-4742-9b97-9f7cf46f10e2 None None] Notifying Schedulers of capabilities ... {{(pid=86805) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}